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SUMMARY 


The  design  and  development  of  the  Unified  Data  Base  (UDB)  for  use  in 
acquisition  logistics  entailed  development  of  softvare  for  a  fully  automated, 
on-line,  interactive  Logistics  Support  Analysis  Record  (LSAR)  information 
system.  In  addition,  the  potential  usefulness  of  LSAR  in  training  development 
and  training  application  of  the  UDB  (UDB2000)  was  investigated. 

This  technical  paper  documents  the  examination  of  developing  training 
requirements  based  on  the  use  of  LSAR  data  and  LSAR  procedures  to  perform 
training  planning  and  development  needs  as  they  arise  in  the  Air  Force.  A  two¬ 
fold  reviev  process  was  used  to  assess  the  present  methods  and  data  elements 
used  in  training  development.  First,  a  reviev  vas  made  of  the  Logistics 
Support  Analysis  process,  completeness  of  LSAR  and  LSAR  data  elements,  and  the 
present  process  of  training  development.  Secondly,  the  3306  Test  and 
Evaluation  Squadron  (TES),  Edvards  AFB,  California,  conducted  a  reviev  and 
evaluation  of  LSAR  and  the  application  of  the  UDB.  Recommendations  are 
provided  for  improved  training  development  procedures,  including  the  use  of 
the  LSAR  and  UDB2000. 
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PREFACE 


This  technical  paper  vas  prepared  by  Systems  and  Applied  Sciences  Corpo¬ 
ration  (SASC),  2875  Presidential  Drive,  Fairborn  Ohio,  under  Air  Force 
Contract  No.  P33615-84-C-0061.  Hr.  Richard  Diehl  vas  the  Project  Leader,  and 
Hr.  Carroll  H.  Staten  vas  the  Principal  Investigator.  The  Air  Force  Human 
Resources  Laboratory  (AFHRL),  Logistics  and  Human  Factors  Division  Acquisition 
Logistics  Branch,  Vright-Patterson  Air  Force  Base,  Ohio,  vas  the  sponsor. 
Captain  Everton  Wallace  vas  the  Program  Hanager. 

SASC,  under  contract  vith  AFHRL,  developed  the  Unified  Data  Base  (UDB), 
as  an  automated  Logistics  Support  Analysis  Record  (LSAR)  system  to  satisfy  the 
requirements  of  the  Logistics  Support  Analysis  (LSA)  process  as  defined  by 
HIL-STD-1388-1A  and  the  data  elements  defined  by  HIL-STD-1388-2A.  In  this 
reviev,  SASC  vas  to  identify  a  functional  area  requiring  a  more  thorough 
examination  of  additional  LSA  requirements.  Training  development  under  LSA 
vas  selected  for  additional  study  and  for  recommendations  for  correcting 
deficiencies.  This  technical  paper  focuses  on  training  requirements, 
usefulness  of  LSAR  data,  and  applications  of  UDB  in  training  requirements 
determination. 


V  -V1  , v, V, 


ACKNOWLEDGEMENTS 


The  authors  also 
the  many  individuals 
paper. 

Ms.  Janet  L.  Peasant 
Lt  Col  Duane  Johnson 
CMS  Jackie  Clark 
MSG  Gary  Buchanan 
MSG  Michael  McMullen 
Lt  Col  Robert  Hovlett 
Capt  Steve  Vilkerson 
Lt  Col  Greg  Sutton 
SMS  James  Bush 
Maj  Andrew  Court  ice 
Capt  Mike  McGovern 
lLt  James  R.  Ayers 
Lt  Col  Joe  Burch 
Mr.  Mike  Miller 
Capt  Mike  McCreary 
Capt  John  Reeder 
Capt  William  McKinney 
Lt  Chris  Palermo 
Capt  Mike  Coover 
Mr.  Chuck  Conley 
Ms.  Jean  Rahilly 
Mr.  Mario  Ramirez 
Ms.  Wendy  Campbell 
Lt  Col  John  Kidd 
Mr.  Dick  Heintzman 
Mr.  Robert  Bankins 
Mr.  Chauncey  Smith 
Mr.  Allan  Mur ton 
Mr.  Dave  McChrystal 


vish  to  acknowledge  the  assistance  and  cooperation  of 
who  contributed  information  and/or  critiques  to  this 


AFHRL/LRA 

3306TES/CC 

3306TES 

3306TES 

3306TES 

ASD/TTGT  (ATC) 

ASD/TTGT  (ATC) 

ASD/ALXS/ALH 

ASD/ALH 

ASD/YWB  (SIMSPO) 
ASD/AFHE  (C-5B  SPO) 
ASD/AFHM  (C-5B  SPO) 
ASD/AFWAA  (C-17  SPO) 
ASD/AFWLR  (C-17  SPO) 
ASD/BILRX  (B-1B  SPO) 
ASD/BILHT  (B-lB  SPO) 
ASD/TAFL  (F-15  SPO) 
ASD/TAFL  (F-15  SPO) 
ASD/YPLA  (F-16  SPO) 
ASD/YPLI  (F-16  SPO) 
AFALC/ERL 
AFALC/ERL 
AFHRL/LRG 
ASD/ENET 
ASD/ENET 
ISS 
ISS 

McDonnell  Aircraft  Co. 
MRSA 


Wright-Patterson  AFB 
Edwards  AFB 
Edwards  AFB 
Edwards  AFB 
Edwards  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Wright-Patterson  AFB 
Clemson,  SC 
Clemson,  SC 
St.  Louis,  MO 
Lexington,  KY 


TABLE  OP  CONTENTS 


INTRODUCTION  . 

1.1  Background  and  Objectives  . 

1.2  Logistic  Support  Analysis  . 

1.3  Data  Documentation  . 

1.4  Tasks  and  Data  Tailoring  . 

1.5  Automated  Data  System  -  Unified  Data  Base 

1 . 6  Summary  . 


LSA/LSAR  AND  USAF  TRAINING  DEVELOPMENT  . 

2 . 1  General  . 

2.2  Methodology  . 

2.3  Training  Requirements  -  The  Process  .  .  . 

2.4  Instructional  Systems  Development  Process 

2.5  Logistic  Support  Analysis  Process  .  .  .  . 

2.6  LSAR  Data  . 

2.7  Data  Element  Definitions  . 

2.8  LSAR  Data  Records  . 

2.9  LSAR  Reports  . 


III.  STUDY  REVIEW  AND  FINDINGS 


Approach  . 

Models/Methods  in  Use  . 

Interface  of  Organizations  . 

Case  Study  of  F-15  Training  Development  .... 

Contract  Training  Development  . 

Standard  Contract  Data  Items  . 

Usefulness  of  LSAR  for  Training  Development  .  . 

Automating  the  Process  .  . 

Adaptability  of  UDB2000  for  Training  Development 

New  Data  Elements/Items  . 

Nev  UDB  Data  Screens /Out put  Reports  . 

Revision  to  MIL-STD-1388-2A  .  . . 


IV.  CONCLUSIONS  . 

4.1  Automating  Training  Requirements  Processes  .... 

4.2  Availability  of  Information  . 

4.3  Organizational/Front-End  Analysis  Influence  .  .  . 

4.4  Military  Standard  Guidance  . 

4.5  Data  Elements/Items  . 

4.6  Manpower,  Personnel,  and  Training  (MPT)  Directorate 

4.7  Recommendations  . 


V.  REFERENCES 


VI.  GLOSSARY  OF  TERMS  AND  ACRONYMS 


L*|t 

ft 


LIST  OF  FIGURES 


FIGURE  PAGE 

1  Model  ISD  Time-Line .  11 

2  LSAR  Data  Flow  for  MPT .  17 

3  ISD  Model .  19 

4  Training  Development  in  Acquisition  .  23 

5  ISD  Training  Analysis  -  Present  Procedure  .  27 

6  LSAR  Tailoring .  33 

7  Data  Item  Description  (DID)  Relationships  to  the  LSAR  ...  34 

8  LSAR  Input  to  Report  Matrix .  35 

9  LSAR  Data  Selection  Sheet .  36 

10  DID  to  LSAR  Record  Relationships .  38 

11  DID  to  LSAR  Report  Relationships .  39 

12  Data  Record  D  Operation  and  Maintenance  Task  Analysis  ...  41 

13  Data  Record  D1  Personnel  and  Support  Equipment  .  42 

14  Data  Record  C  Operation  and  Maintenance  Task  Summary  ....  44 

15  Data  Record  E  Support  Equipment  or  Training  Material  Descrip¬ 
tion  and  Justification .  45 

16  Data  Record  G  Skill  Evaluation  and  Justification  .  46 

17  LSAR  for  Training  Development  in  Acquisition .  48 

18  Automated  Training  Requirements  Process  .  55 


vi 


L 


juuwBfrroi  fononnn^  m  xx  y*  wn  tfn  wn  '/iryv'jv  vwn>v\*j~v  unw  ^  "  ir^vxvirarxvY\rwv 


-^7 ^ MTTvrT  jt  *  v-  *.-  x/tut'  w  yr  v^irxrx 


LIST  OF  TABLES 


TABLE  PAGE 

1  Training-Related  Data  Element  for  ISD .  SO 

2  Training-Related  Data  Information  (MIL-STD-1388-2A  and 

UDB2000) . . .  58 

3  Supplemental  Data  Elements  (UDB2000)  .  72 


I.  INTRODUCTION 


1.1  BACKGROUND  AND  OBJECTIVES 

A.  The  design  and  development  of  the  Unified  Data  Base  (UDB)  for 
Acquisition  Logistics  project  vill  develop  an  automated  on-line 
Logistics  Support  Analysis  Record  (LSAR)  for  use  by  contractors  and 
Government  personnel.  A  subtask  of  this  project  was  to  study  the 
potential  usefulness  of  LSAR  in  training  development  and  training 
applications  of  the  UDB  (UDB2000). 

B.  The  LSA  process,  as  defined  by  MIL-STD-1388-1A,  and  the  LSAR  process, 
as  defined  by  MIL-STD-13882A,  vere  evaluated  for  the  purpose  of  in¬ 
creasing  the  effectiveness  of  Logistics  Support  Analysis  (LSA)  in 
influencing  veapon  system  supportability .  Based  upon  the  UDB2000 
capability  to  fully  automate  the  LSAR  process,  it  was  determined  that 
a  functional  LSA  user  area  should  be  identified  for  a  more  thorough 
examination  of  additional  LSA  requirements.  The  functional  area 
selected  was  to  be  an  area  vhich  lacked  the  information,  data 
analysis  methodology,  or  documentation  to  influence  supportability  on 
a  timely  basis.  This  technical  paper  thus  focuses  on  the  area  of 
training  requirements  in  relation  to  the  usefulness  of  LSAR  data  and 
applications  of  UDB2000. 

C.  Training  requirements  vere  examined  based  upon  the  ability  of  LSAR 
data  and  LSAR  procedures  to  fulfill  training  planning  and  development 
needs  as  they  arise  in  the  Air  Force.  The  Air  Training  Command's 
(ATC)  3306  Test  and  Evaluation  Squadron  (TES)  was  made  a  part  of  the 
study  effort  since  its  mission  is  to  plan  for  system  maintenance 
training  during  system  acquisition/test  and  evaluation.  The  3306  TES 
uses  the  Instructional  System  Development  (ISD)  process  as  the 
primary  tool  in  training  development.  The  3306  TES  assisted  in  the 
revlev  and  evaluation  of  current  use  and  adequacy  of  MIL-STD-1388-1A 
and  MIL-STD-1388-2A,  and  the  adaptability  of  the  UDB. 

1.2  LOGISTICS  SUPPORT  ANALYSIS 

A.  Logistics  Support  Analysis  (LSA),  as  defined  in  MIL-STD-1388-1A,  is 
the  selective  application  of  scientific  and  engineering  efforts 
undertaken  during  the  acquisition  process,  as  part  of  the  system 
engineering  and  design  process,  to  assist  in  complying  with  support- 
ability  and  other  Integrated  Logistics  Support  (ILS)  objectives.  The 
LSA  process  applies  to  all  system  and  acquisition  programs,  major 
modification  programs,  and  research  and  development  projects 
throughout  all  phases  of  the  systea/equipacnt  life  cycle.  LSA  should 
bring  together  all  the  design  and  support  concepts  needed  to  meet 
operational  requirements  through  examining  hov  functions  vill  be 
performed  meeting  technical  requirements,  and  considering  system 
engineering  trade-offs. 

B.  The  analysis  process  provides  general  support  requirements  and 
descriptions  of  tasks  vhich  permit  flexibility  in  tailoring  to  meet 
program  objectives  as  determined  by  the  System  Program  Office  (SPO). 
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This  tailoring  process  can  occur  only  vhen  the  "requiring  authority" 

(usually  the  Government)  requires  that  these  specific  tasks  be  done 
and  that  all  essential  information  relevant  to  implementation  be 
provided  by  the  "performing  activity"  (usually  a  contractor).  The 
process  is  applied  in  accordance  with  MIL-STD-1388-1A,  which  provides 
a  basis  for  the  selection  of  tasks  to  be  included  in  the  contract 
Statement  of  Vork  (SOV).  It  is  intended  that  this  systematic  and 
comprehensive  analysis  be  conducted  on  an  iterative  basis.  The  level 
of  detail  and  timing  of  task  performance  should  be  consistent  vith 
program  schedules  and  milestones. 

C.  In  addition,  the  tailoring  process  prescribes  the  use  of  other  LSA 
documentation  on  tasks  performed  in  previous  program  phases,  other 
system  engineering  program  requirements  and  logistics  related  Data 
Item  Descriptions  (DID)  included  in  the  solicitation  document.  This 
accumulation  of  documentation  vill  provide  an  audit  trail  of 
supportability  and  supportability-related  design  analyses  and  deci¬ 
sions,  and  vill  form  the  basis  for  actions  and  documents  related  to 
manpover  and  personnel  requirements,  resource  allocation,  training 
programs,  maintenance  planning,  provisioning,  funding,  and  other 
logistics  support  resource  requirements. 

D.  The  bringing  together  of  the  design  and  support  concepts,  of  course, 
lies  vith  the  program  manager.  It  is  through  SPO  emphasis  during 
system  engineering  that  LSA  can  be  applied  to  influence  design  and 
supportability.  An  example  could  be  maintainability,  which  during 
the  design  phase  incorporates  accessibility,  interchangeability, 
standardization,  etc.,  and  affects  panel  design,  spares,  technical 
manuals  and  corresponding  personnel/ training  needs. 

1 . 3  DATA  DOCUMENTATION 

A.  Data  documentation  under  the  LSA  process  can  be  considered  unique,  as 

it  is  to  be  accomplished  on  an  iterative  basis  through  all  phases  of 
the  system  or  equipment  life  cycle  vith  the  goal  of  satisfying  the 
support  analysis  objectives.  The  documentation  is  to  consist  of  all 
data  resulting  from  the  analysis  tasks  and  serves  as  the  primary 
source  of  validated,  integrated  design  related  supportability  data 
pertaining  to  acquisition  programs.  Here  lies  one  of  the  key  issues 
vith  LSA  and  LSA  documentation:  Successful  use  of  the  standard 
depends  upon  the  quality  and  completeness  of  the  documentation.  As 
defined  in  the  standard:  "LSA  documentation  shall  be  developed  and 
maintained,  commensurate  vith  design,  support,  and  operational  > 

concept  development,  and  shall  be  updated  to  reflect  changes  or 
availability  of  better  information  based  on  testing,  configuration 
changes,  operational  concept  changes,  and  support  concept  changes 

during  the  acquisition  process."  Documentation  which  is  complete, 
accurate,  and  up-to-date,  provides  a  suitable  basis  for  necessary 
actions  and  documentation  for  manpover  and  personnel  requirements, 
training  programs,  and  other  requirements  previously  stated.  j 

B.  This  documentation  process  is  performed  using  the  Logistics  Support 

Analysis  Record  (LSAR) ,  which  requires  the  use  of  many  related  | 

documents  from  which  appropriate  data/ codes  can  be  obtained.  The 
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LSAR  data  ara  to  sarve  as  tha  integrated  logistics  support  technical 
database  applicable  to  all  materiel  acquisition  programs.  To  this 
end,  a  standard  Joint  Service  LSAR  Automated  Data  Processing  (ADP) 
system  for  automation  of  LSAR  data  has  been  developed.  This  system 
generates  the  LSAR  master  files  described  in  MIL-STD-1388-2A.  The 
LSAR  data,  whether  collected  through  automation  or  manually,  forms 
the  necessary  database. 


1.4  TASKS  AND  DATA  TAILORING 

A.  The  LSA  process  objectives  are  established  by  program  life-cycle 
phases  and  Involve  five  general  taskings  as  outlined  in  sections  of 
the  standard.  These  tasking  sections  provide  the  general  purpose  of 
each  section,  the  individual  tasks  contained  in  each  section,  and  the 
general  purpose  of  each  task  and  subtask.  The  sections  provide  for 
detailed  analysis  in  the  following  areas: 

Section  100  Program  Planning  and  Control 

Section  200  Mission  and  Support  System  Definition 

Section  300  Preparation  and  Evaluation  of  Alternatives 

Section  400  Determination  of  Logistics  Support  Resource 

Requirements 

Section  500  Supportability  Assessment 

B.  Individual  tasks  are  divided  into  four  parts:  purpose,  task  descrip¬ 
tion,  task  input,  and  task  output.  The  purpose  states  the  general 
reason  for  performing  the  task;  the  task  description  is  comprised  of 
detailed  subtasks.  The  task  input  identifies  the  general  information 
required  to  define  the  scope  of  each  task  and  to  perform  each  task. 
The  task  output  identifies  the  expected  results. 

C.  The  requiring  authority  uses  MIL- STD- 1388-1 A  in  the  selection  of 
tasks  for  inclusion  in  the  SOW  and  establishes  the  LSA  documentation 
requirements  based  upon  the  elements  identified  in  the  tasks. 
Applicable  DIDs  that  describe  the  data  to  be  generated  by  the 
contractor  are  shown  in  Table  III  of  the  standard.  The  DIDs  are 


designed 

to  provide  a 

maximum  range  of  data,  but  they  can  be  tailored 

for  individual  programs.  The  following  DIDs  apply  to  selected  major 
tasks: 

Task 

DID  No. 

Title 

101 

DI-L-7114 

LSA  Strategy  Report 

102 

DI-L-7017A 

LSA  Plan 

201 

DI-S-7115 

Use  Study  Report 

203 

DI-S-7116 

Comparative  Analysis  Report 

204 

DI-S-7117 

Technological  Opportunities  Report 

402 

DI-S-7118 

Early  Fielding  Analysis  Report 

403 

DI-S-7119 

Post  Production  Support  Plan 

501 

DI-S-7120 

Supportability  Assessment  Plan 

601 

DI-S-7121 

Supportability  Assessment  Report 

D.  Although  LSA  is  to  b«  initiated  during  the  early  phases  of  the  life 
cycle,  it  is  not  until  the  Demonstration  and  Validation  (DEM/VAL) 
phase  that  definitive  tailoring  begins.  The  analysis  and  docu¬ 
mentation  include  equipment  operation  and  maintenance  levels  dovn  to 
subsystems  and  associated  subassemblies  and  parts.  At  this  point, 
system  design  and  material  support  can  still  be  influenced  by  the 
SPOs  through  contractual  specifications. 

E.  Selection  of  some  LSA  tasks  will  result  in  data  which  are  to  be  input 
directly  into  the  LSAR.  MIL-STD-1388-2A,  Table  II  provides  a  list  of 
those  LSA  tasks  and  subtasks  which  relate  directly  to  the  LSAR  data 
records.  The  recording  of  the  data  elements  is  accomplished  using 
the  LSAR  Data  Selection  Sheets  (DD  Pores  1949-1).  The  data  selection 
sheets  provide  the  requiring  authority  with  a  means  for  identifying 
to  the  performing  activity  the  required  LSAR  data  elements  to  be  com¬ 
pleted.  Preparation  of  DD  Form  1949-1  should  be  a  result  of  the  LSAR 
tailoring  process.  Thus,  the  preparation  and  maintenance  of  LSAR 
data  are  directly  related  to  the  hardware  and  software  design  of  an 
end  item.  The  requiring  authority  is  in  fact  responsible  for  speci¬ 
fying  the  equipment  indenture  level  and  the  level  of  maintenance  for 
which  the  LSAR  data  will  be  prepared  and  maintained. 

F.  The  LSAR  provides  a  structured,  standardized,  yet  flexible  approach 
to  the  documentation  and  use  of  the  data  required  to  effectively 
accomplish  LSA  tasks. 

l.S  AUTOMATED  DATA  SYSTEM  -  UNIFIED  DATA  BASE 

A.  The  Logistics  and  Human  Factors  Division  of  the  Air  Force  Human 
Resources  Laboratory  sponsored  the  development  of  the  "UDB  for 
Acquisition  Logistics  (UDB2000)."  The  UDB2000  is  an  advanced 
database  management  system  that  permits  on-line  interactive  entry, 
retrieval,  and  analysis  of  LSAR  information. 

B.  The  UDB  softvare  is  a  powerful  and  sophisticated  tool  that  integrates 
LSA-related  information  from  various  functional  ILS  areas.  This 
integration  provides  users  of  the  system  vith  a  central  repository  of 
related  information  intended  to  serve  all  functional  LSA  areas.  The 
UDB2000  is  fully  compatible  vith  the  military  standard  requirements 
and  provides  enhancements  beyond  the  standard.  The  system  affords 
on-line  data  sheets/report  screens  and  real-time  calculations.  The 
UDB2000  uses  the  Integrated  Data  Management  System  (IDMS)  and  the 
Integrated  Data  Dictionary  (IDD).  Thus,  the  capability  exists  to 
maintain  relationships  among  data  elements  in  the  database  and  also 
provide  a  centralized  dictionary  in  vhich  to  define  and  link  together 
data  elements,  records,  and  files.  Data  are  stored  only  once  but  are 
linked  to  all  possible  applications. 

C.  MIL-STD-1388-2A  provides  a  Data  Elemant  Dictionary  (DED)  for  the 

LSAR,  and  information  for  interpreting  and  using  the  LSAR.  The 

dictionary  contains  all  the  data  elements,  acronyms,  and 

abbreviations  that  appear  on  the  LSAR  data  records.  The  dictionary 
is  incorporated  fully  into  the  UDB2000. 


1.6  SUMMARY 

The  overview  provides  insight  to  the  LSA  process  and  its  application 
within  the  Department  of  Defense  and  civilian  contractor  community.  The  goal 
of  MIL-STD-1388-1A  is  to  institute  a  single,  uniform  approach  for  use  by  the 
Military  Services  in  conducting  those  activities  which  will: 

Ensure  supportability  requirements  become  an  integral  part  of  system 
requirements  and  design; 

define  support  requirements  that  are  optimally  related  to  system 
design  and  to  each  other; 

define  the  required  support  during  the  operational  phase;  and 
result  in  high-quality  data  products. 


II.  LSA/LSAR  AND  USAF  TRAINING  DEVELOPMENT 


2 . 1  GENERAL 

A.  The  LSA/LSAR  processes  described  in  MIL-STD-1388-1A  and 
MIL-STD-1388-2A  were  evaluated  for  adequacy,  effectiveness,  vi¬ 
ability,  and  applicability  in  training  development.  A  review  was 
conducted  of  the  models/methodologies  used  by  training  functional 
managers  to  determine  the  extent  of  their  application  within  SPOs. 

B.  The  study  focused  on: 

(1)  Reviewing  MIL-STD-1388-1A  and  MIL-STD-1388-2A  for  adequacy  and 
completeness  with  respect  to  USAF  training  development  needs. 

(2)  Evaluating  the  LSA  process  and  completeness  of  the  data  elements 
in  terms  of  their  ability  to  meet  training  requirements. 

(3)  Identifying  any  nev  methods,  procedures,  or  models  which  could 
improve  training  development  in  terms  of  effectiveness  and 
timeliness. 

(4)  Evaluating  the  degree  to  which  training  information  needs  are 
satisfied  by  the  current  UDB  and  the  UDB  data  elements. 

(5)  Identifying  preliminary  on-line  data  entry  screens  and  output 
reports  which  appear  to  meet  requirements  for  training  informa¬ 
tion. 

C.  Based  upon  the  above  examinations  vhere  appropriate,  recommendations 

vere  made  concerning  the  automation  of  additional  data  elements  for 
inclusion  within  the  UDB2000;  a  means  to  incorporate  additional  data 
elements  to  existing  on-line  data  entry  screens;  additional 

on-line  query  screens  or  output  report  formats  to  support  general 
information  requests;  and  specifications  for  changed  or  additional  LSA 
tasking. 
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2.2  METHODOLOGY 


A  twofold  review  process  vas  used  to  assess  the  current  methods  and  data 
elements  used  in  training  development.  First,  Systems  and  Applied  Sciences 
Corporation  (SASC)  revieved  the  LSA  process,  completeness  of  LSAR  and  LSAR 
data  elements,  and  the  present  process  of  training  requirement  development. 
Second,  the  3306  Test  and  Evaluation  Squadron  (TES)  conducted  a  review  and 
evaluation  of  current  use  and  adequacy  of  MIL-STD-1388-1A  and  MIL-STD-1388-2A, 
and  the  adaptability  of  UDB2000,  for  training  development  application.  The 
results  were  analyzed  to  determine  how  veil  the  current  LSAR  and  UDB 

development  satisfied  data  requirements  for  ISD  in  particular.  The  findings  of 
the  3306  TES  and  the  above  review  are  included  in  this  paper. 

2.3  TRAINING  REQUIREMENTS  -  THE  PROCESS 

A.  Early  determination  of  training  requirements  has  long  been  a  goal  of 
Air  Force  planners.  It  vas  not  until  1973  that  the  Air  Force  Chief  of 
Staff  directed  the  application  of  the  ISD  process  to  all  nev  weapon 
systems  or  major  modifications  under  acquisition.  To  meet  this 
objective,  the  Air  Training  Command  (ATC),  in  1973,  performed  an  ISD 
pilot  study  on  the  B-l  aircraft  pneudraulic  system  vhich  determined 
that  (a)  test  and  evaluation  maintenance  data  could  be  used  for  ISD, 
and  (b)  ISD  could  be  used  during  acquisition  to  identify  system 
maintenance  training  requirements  and  develop  technical  training 
material.  Based  on  the  results  of  the  study,  the  3306th  TES  vas 

'  formed  in  May  1975,  with  the  mission  to  support  ATC's  role  in  system 

i  acquisition,  test,  and  evaluation  through  planning  for  system  mainte- 

J  nance  training,  and  identifying  technical  training  material  using  the 

ISD  process.  The  3306  TES  consists  of  a  small  cadre  of  experienced 
,  ISD  subject-matter  specialists  located  primarily  at  Edvards  AFB, 

California.  Their  involvement  vith  nev  systems  usually  begins  on  or 
j  about  the  time  a  prototype  aircraft  is  sent  to  Edvards  AFB  for  test 

and  evaluation  by  the  Air  Force  Operational  Test  and  Evaluation 
Center  (AFOTEC).  At  times,  the  3306  TES  also  hosts  ISD  teams  for 
systems  not  yet  to  the  prototype  state.  In  either  case,  individuals 
are  assigned  to  an  ISD  team  primarily  based  on  their  present 
i  assignment  as  technical  instructors  and  their  future  assignment  as 

|  instructors  at  Field  Training  Detachments  (FTDs)  for  the  operational 

units;  however,  they  may  be  dravn  from  the  technical  school,  FTD 
units,  the  using  command,  or  other  resources  as  necessary. 

B.  Training  planning  is  a  continuous  process,  and  training  development 

,  follows  the  same  course  as  the  development  of  the  systems  it  will 

I  support.  The  process  begins  when  Air  Force  Headquarters  issues  a 

|  Program  Management  Directive  (PMD)  directing  the  acquisition  process 

through  an  established  or  to-be-established  SP0.  The  PMD  outlines 
responsibilities  and  general  management  objectives.  Headquarters  ATC 
appoints  a  single-point  manager  in  the  Directorate  of  Acquisition  to 
manage  its  participation  in  the  early  stages  of  a  weapon  system. 
Also,  ATC  assigns  a  Responsible  Test  Agency  (RTA),  such  as  the  3306 
TES.  Thus,  ATC  is  involved  in  planning  training  support  for  a  nev 
system  from  the  inception  of  the  system  through  the  end  of  its  opera- 
I  tional  life.  ATC  tasking  includes  defining  training  concepts, 

identifying  training  and  training  resource  requirements,  and 


developing  and  implementing  plans  to  meet  the  requirements.  In  this 
effort,  a  Test  Participation  Plan  is  developed  in  sufficient  depth  to 
ensure  comprehensive  management  and  application  of  the  ISD  process. 

C.  This  process  leads  to  creating  a  qualified  ISD  team  trained  in  ISD 
procedures  and  knovledgeable  in  associated  directives,  technical 
orders,  and  military  standards.  The  ISD  team  compiles  an  initial  data 
base  of  system  maintenance  requirements  obtained  from  the  folloving 
sources: 

(1)  Using  Command 

(2)  Contractor 

(3)  System  Program  Office 

(4)  Test  Force 

(5)  Field  Training  Group 

(6)  Other 

D.  This  effort  starts  the  analysis  of  the  databas*  for  identifying 
training  requirements.  ATC  also  revlevs  the  Statement  of  Operational 
Need  (SON)  to  ensure  training  considerations  include  the  system's 
operational  and  support  concepts.  The  using  command  is  responsible 
for  establishing  the  maintenance  concept. 

E.  Once  the  data  are  collected  and  the  maintenance  concept  established, 
the  ISD  team  begins  the  ISD  analysis  using  a  14-step  adaptation  of 
the  standard  Air  Force  ISD  model.  As  necessary,  ATC  provides  training 
specialists  to  the  SPO  to  ensure  that  training  development  occurs  in 
coordination  with  system  development.  The  process  is  one  of  develop¬ 
ing  training  programs  in  response  to  requirements  identified  by  the 
SPO  and  the  major  using  command. 

F.  The  ATC  Training  Advisory  Office  to  the  Aeronautical  Systems  Division 
(ASD),  Air  Force  Systems  Command,  plays  an  important  role  in  defining 
the  training  requirements  for  the  many  SPOs.  Although  this  office 
has  limited  manning,  Training  Support  Managers  are  assigned  to  each 
ASD  program.  The  level  of  effort  vill  vary  depending  upon  the 
program  development  stage.  Initial  effort  could  be  high  at  the  onset 
of  planning  and  the  subsequent  program  documentation  development. 
The  Advisory  Office  assists  the  SPO  as  a  member  of  the  Training 
Planning  Team  (TFT)  and  in  the  development  and  coordination  of  the 
Training  Development  Plan  (TOP)  under  the  guidance  of  APR  50-8, 
Policy  and  Guidance  for  Instructional  System  Development  (ISD). 

G.  The  level  of  effort  is  directly  related  to  the  SPO  emphasis  on 
training-related  issues.  The  ATC  Advisory  Office  and  their  Training 
Support  Managers  stand  ready  to  guide  and/or  vork  any  training  issues 
throughout  the  program  life  cycle.  The  folloving  list  shovs  those 
areas  in  vhich  ATC  assists  the  SPO  in  training  planning  for 
acquisition  programs: 

(1)  Establishing  a  TPT  and  developing  a  TDP. 

(2)  Using  the  TDP  as  a  basis  for  inputs  to  manpower,  personnel,  and 
training  sections  of  the  Program  Management  Plan  (PMP),  Inte- 


grated  Logistics  Support  Plan  (ILSP),  baseline,  and  other 
program  decision  documents. 

(3)  Ensuring  a  training  equipment  Source  Selection  Evaluation  Board 
is  conducted  in-house  or  by  the  prime  contractor.  ATC  contri¬ 
butes  source  selection  criteria/standards. 

(4)  Initiating  a  Training  Planning  Information  Document  by  contract 
to  identify  training  and  training  equipment  recommendations  as 
outlined  in  DI-H-7066. 

(5)  Participating  in  Training  Requirements  Recommendation  Reviev 
Meetings. 

(6)  Budgeting  special  training  requirements. 

H.  The  above  planning  and  action  areas  are  performed  vith  and  through 
the  assistance  of  the  ATC  Training  Support  Manager  assigned  to  work 
vith  the  acquisition  program. 

I.  The  result  is  a  training  program  vhich  should  ensure  that  maintenance 
personnel  are  qualified  to  perform  their  assigned  duties.  The 
completed  training  packages  and  training  equipment  will  permit 
training  to  be  performed  by  instructors  of  contractor  schools,  ATC 
resident  technical  schools,  mobile  training  teams  (MTTs),  and 
unit-level  technicians. 

2.4  INSTRUCTIONAL  SYSTEM  DEVELOPMENT  PROCESS 

A.  Since  this  paper  concerns  LSA,  UDB2000,  and  training,  it  is  appro¬ 
priate  to  briefly  describe  the  ISD  procedures  as  applied  by  the  3306 
TES.  The  3306  TBS  currently  uses  a  specially  adapted  version  of  ISD 
for  the  development  of  maintenance  training  and  training  equipment 
for  nev  weapon  systems,  as  described  in  the  3306  Procedural  Handbook 
(January  1983).  Their  version  of  the  Air  Force  five-step  ISD  model  is 
divided  into  14  procedural  steps* 

STEP  1  Identify  System  Maintenance  Requirements 

-  gather  data  and  identify  all  the  duties  and  tasks  related  to 
the  veapon  system  under  development  or  modification. 

STEP  2  Identify  Characteristics  of  the  Target  Population 

-  analyse  vhat  students  already  knov  and  vhat  they  are  able  to  do 
now. 

STEP  3  Determine  Training  Requirements 

-  determine  vhat  training  requirements  are  needed  for  the  knovn 
student  population. 
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STEP  4  Determine  Types  of  Technical  Training  Materials  Required 


-  identify  general  classes  of  training  media. 

STEP  5  Develop  Instructional  Strategies 

sequence  Che  Casks  inCo  logical  lessons  and  blocks  of 
instruction. 

STEP  6  Identify  Fidelity  Requirements  of  Hardware  Components 

-  determine  the  degree  of  realism  required  of  each  component  to 
be  included  in  the  hardware  trainer. 

STEP  7  Select  Instructional  Features  for  Hardware  Media 

-  identify  features  needed  for  hardware  training  if  actual 
equipment  will  not  be  used. 

STEP  8  Prepare  an  ISD-Derived  Training  Equipment  Specification 

-  specify  the  numbers  and  type  of  trainers  required,  functional 
capabilities,  component  fidelity,  and  instructional  features. 

STEP  9  Identify  Method  of  Instruction 

-  select  the  methods  of  instruction  needed  to  accomplish  each 
training  requirement. 

STEP  10  Prepare  Course  Control  Documents 

-  prepare  course/specialty  training  standards,  course  charts, 
plans  of  instruction,  and  other  course  documents. 

STEP  11  Prepare  Instructional  Materials  and  Tests 

-  prepare  all  course  materials  and  tests 
STEP  12  Validate  Instruction 

-  conduct  a  dry  run  of  the  entire  training  course 
STEPS  13  and  14  Conduct  and  Evaluate  Training 

-  continuing  reevaluation  during  the  life  of  the  course  is 
conducted  by  instructors  and  supervisors  assigned  to  the 
technical  training  school  or  field  training  detachments. 

B.  ISD  provides  a  systems  approach  for  planning,  developing,  and 
managing  a  training  program  in  support  of  a  weapon  system.  The 
purpose  here  is  not  to  expound  on  the  process  but  to  briefly  high¬ 
light  the  relationship  between  this  step-by-step  procedure  and 
LSA/LSAR.  In  this  regard,  Step  1  is  of  primary  concern,  since  most 
often  little  or  no  hard  data  are  available  on  the  weapon  system  (or 
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aajor  modification)  in  this  early  stage  of  the  ISD  process.  Thus,  in 
som  cases,  it  is  necessary  for  the  3306  TBS  to  visit  contractor 
facilities  to  coapile  the  initial  database.  This  entails  tiae,  aoney, 
and  in-depth  interviews  with  contractor  engineers  and  technicians. 

C.  At  this  point,  it  is  appropriate  to  show  the  "Model  ISD  Tlae-Line” 
used  for  planning  purposes  and  usually  applied  vhen  the  first  article 
delivery  date,  the  Initial  Operating  Capability  (IOC),  is  forecasted. 
Normally,  S3  months  are  required  to  put  trained  maintenance  personnel 
in  place  by  first  article  delivery  date  (see  Figure  1).  In  essence,  a 
period  in  excess  of  4  years  is  planned  to  more  or  less  coincide  with 
the  system  test  and  evaluation  cycle. 

D.  The  first  3  months  of  an  ISD  effort  allow  for  selection  of  personnel 
resources  and  the  collection  of  available  data.  The  following  9 
months  are  used  to  analyze  the  data  for  Technical  Training  Material 
(TTM)  recommendations.  In  turn,  the  requirements  are  reviewed  by 
Headquarters  ATC  in  the  Training  Requirements  Recommendation  Review 
Meeting  (TRRRM) .  Although  not  a  formal  ISD  step,  the  approved  TRRRM 
package  provides  the  SPO  with  those  TTM  items  requiring  funding  and 
procurement  action. 

E.  It  is  important  to  note  that  the  whole  process  could  be  less  than 
effective  if  adequate  data,  both  in  quantity  and  quality,  cannot  be 
obtained  in  the  early  stage.  LSAR  under  MIL-STD-1388-2A  becomes  a 
vital  data  source  if  applied  during  the  Integrated  Logistics  Support 
Planning,  the  LSA,  and  the  ISD  efforts. 

2.5  LOGISTICS  SUPPORT  ANALYSIS  PROCESS 

A.  The  LSA  process  can  be  divided  into  tvo  parts:  (a)  the  analysis  of 
supportability,  and  (b)  the  assessment  and  verification  of  support- 
ability.  The  first  part  starts  at  system  level  within  the  design  and 
operational  concepts  and,  after  processing  through  the  various 
analysis  considerations,  moves  to  a  lover  level  of  indenture.  Subse¬ 
quent  lover-level  analyses  then  define  the  logistics  support  re¬ 
sources  requireMnts  through  the  integrated  analysis  of  operator  and 
maintenance  functions  and  tasks;  these  analyses  address  task 
frequencies,  task  tiMs,  personnel  and  skill  requireMnts,  supply 
support,  and  other  needs.  The  second  part  concerns  the  system  or 
equipMnt  life  cycle  performance  and  adjustments  thereto. 

B.  MIL-STD-1388-2A  outlines  LSA  requireMnts  down  to  the  subtask  level, 

since  this  level  of  detail  is  needed  to  adapt  them  to  specific 
acquisition  prograM  and  specific  phases.  The  level  of  detail 

selected  and  the  timing  of  task  performance  should  be  tailored  to 
each  system  or  equipMnt.  The  military  standard  provides  a  general 
tailoring  decision  logic  tree  to  be  folloved  in  task  selection. 

C.  In  essence,  a  productive  but  cost-effective  LSA  effort  must 

concentrate  available  resources  on  those  activities  vhich  are  most 
beneficial.  This  calls  for  selection  of  those  tasks  and  subtasks 

vhich  can  be  adjusted  based  on  considerations  listed  in 

MIL-STD-1388-2A.  These  considerations  consist  of: 
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(1)  Amount  of  design  freedom 

(2)  Time  phasing  adjustments  (fast  track  programs) 

(3)  Work  already  done 

(4)  Data  availability  and  relevancy 

(5)  Time  and  resource  availability 

(6)  Policy  directive  information  needs 

(7)  Desired  tasks  not  in  the  standard 

(8)  Procurement  considerations 

These  factors  are  discussed  in  detail  vithin  the  military  standard 
and  will  be  discussed  only  in  part  here. 

D.  Work  already  done,  data  availability  and  relevancy,  and  procurement 
considerations  all  play  a  key  role  in  the  use  of  LSAR  for  training 
requirements.  The  collection  process  at  best  must  take  advantage  of 
past  experience  and  historical  data.  Available  databases  must  be 
reviewed  for  relevancy,  and  the  SPO  must  decide  and  specify  the  LSA 
tasks  for  contractor  or  Government  performance.  Thus,  the  request 
for  proposal  (RFP)  becomes  the  key  to  what  LSA  data  the  training 
function  can  expect,  and  what  degree  of  importance  the  SPO  places  on 
needed  documentation.  The  LSAR  is,  in  fact,  a  subset  of  LSA 
documentation,  and  delivery  of  LSAR  data  should  be  specified  in  the 
contract  data  requirements  list  (CDRL,  DD  Form  1423). 

E.  MIL-STD-1388-2A  prescribes  the  use  of  LSAR  data  selection  sheets  (DD 
Form  1949-1)  as  the  means  of  identifying  the  required  LSAR  data 
elements.  Preparation  of  the  data  sheets  is  the  result  of  the  LSAR 
tailoring  process  discussed  above. 

2.6  LSAR  DATA 

LSAR  data  are  usually  prepared  by  the  contractor.  However  as  previously 
stated,  the  3306  TES  has  assisted  in  specific  data  development  at  contractor's 
facilities.  In  any  event,  the  LSAR  data  are  directly  related  to  the  hardware 
and  software  design  of  the  end  item  being  procured.  The  LSAR  data  nay  be 
prepared  and  maintained  manually  or  by  data  automation,  or  by  a  combination  of 
methods.  Use  of  an  automated  ADP  system  requires  validation  by  the  Joint- 
Service  office  at  KRSA.  Currently,  a  Joint-Service  LSAR  ADP  system  may  be  used 
for  LSAR  data,  or  the  Services  nay  use  their  own  unique  systems  for  internal 
processing  of  LSAR  data. 

2.7  DATA  ELEMENT  DEFINITIONS 

To  provide  a  better  understanding  of  the  LSAR  process,  the  following  de¬ 
finitions  are  supplied.  These  definitions  all  relate  to  data  elements  that 
appear  on  the  LSAR  data  records.  The  LSAR  data  elements  are  standard,  as 
prescribed  by  the  military  standard.  A  supplemental  listing  of  Data  Elements 
was  prepared  during  UDB2000  development. 


(1)  Data  Eleaent: 

Technical  data  required  to  support  an  integrated  logistic 
support  progran.  These  data  are  standardized  using  LSAR  data 
element  definitions. 

(2)  Data  Element  Definition  (PEP); 

A  narrative  definition  of  the  Data  Element  in  sufficient  detail 
to  present  a  clear  and  complete  understanding  of  the  precise 
data  or  element  of  information  that  the  data  element  represents. 

(3)  Data  Element  Definition  (PEP)  Number: 

A  sequentially  assigned  number  given  to  each  data  element  in  the 
dictionary  for  use  in  locating  and  referencing  the  element 
throughout  the  dictionary  and  data  entry  instructions  (see  MIL- 
STD-1388-2A,  Appendix  A). 

(4)  Data  Element  Title: 

The  noun  phrase  name  used  to  identify  the  data  element.  Suffi¬ 
cient  adjectives/modifiers  are  used  with  the  noun  name  to  ensure 
title  uniqueness. 

(5)  Data  Item: 

One  of  a  set  of  descriptive  items  of  information  or  values  that 
applies  to  a  data  eleaent  (e.g. ,  the  data  eleaent  "Skill  Level 
Code"  contains  the  data  items  "Basic,"  "Intermediate,"  and 
"Advanced") . 

(6)  Data  Code: 

One  or  more  alphabetical,  numerical,  or  special  characters  that 
represent  data  items  that  are  to  be  entered  in  a  field  on  an 
LSAR  data  record;  e.g., 

Data  Eleaent  -  "Update  Code" 

Data  Items  -  "A"  -  addition;  "C"  -  change; 

"D"  -  deletion 

(7)  Data  Item  Description  (DID): 

A  fora  (DD  Fora  1664)  used  to  define  and  describe  the  data 
required  to  be  furnished  by  the  contractor  (provided  to  contrac¬ 
tors  for  identification  of  each  data  item  listed  on  the  CDRL); 


DI-H-3258A  "Training  Support  Data  LSAR  Application"  use  B, 
D,  Dl,  E,  El  and  G  data  records. 


2.8  LSAR  DATA  RECORDS 


A.  At  present,  the  series  of  LSAR  data  records  contained  in  MIL-STD- 
1388-2A  consists  of  records  A  through  J.  The  LSAR  is  a  standardized 
process  for  systematically  recording,  storing,  processing,  and  dis¬ 
playing  system  and  equipment  analysis  data.  Input  data  are  prepared 
by  the  performing  activity  in  accordance  with  the  standard.  Note 
that  all  LSAR  data  refer  to  individual  "end  items"  of  equipment  vhich 
are  referenced  by  work  unit  codes  and  nomenclature.  The  following 
LSAR  data  records  are  part  of  the  Joint-Service  LSAR  ADP  system: 

(1)  A  Record  Operation  and  Maintenance  Requirements 

(2)  *B  Record  Item  Reliability  (R)  and  Maintainability  (M)  Charac¬ 

teristics 

(3)  B1  Record  Failure  Modes  and  Effects  Analysis 

(4)  B2  Record  Criticality  and  Maintainability  Analysis 

(5)  *C  Record  Operation  and  Maintenance  Task  Summary 

(6)  *D  Record  Operation  and  Maintenance  Task  Analysis 

(7)  *D1  Record  Personnel  and  Support  Requirements 

(8)  *E  and  El  Support  Equipment  or  Training  Material  Description 

Record  and  Justification 

(9)  E2  Record  Unit  Under  Test  Description  and  Justification 

(10)  F  Record  Facility  Description  and  Justification 

(11)  *G  Record  Skill  Evaluation  and  Justification 

(12)  H  Record  Support  Items  Identification 

(13)  HI  Record  Support  Items  Identification  (Application-Related) 

(14)  J  Record  Transportability  Engineering  Characteristics 

*  Has  implications  for  training  development  requirements 

B.  Source  documentation  is  usually  done  by  the  prime  contractor  accord¬ 
ing  to  MIL-STD-1388-2A,  and  any  revised  input  data  record  formats  or 
data  element  definitions  must  be  approved  by  the  requiring  authority 
during  contract  negotiation.  In  this  manner,  LSAR  data  are  generated 
as  a  result  of  the  analysis  tasks  outlined  in  MIL-STD-1388-1A.  LSAR 
data  become  the  ILS  technical  database  to  support  material  acquisi¬ 
tion  programs. 

C.  The  following  descriptions  are  abstracted,  in  part,  from  the  military 
standard  in  order  to  highlight  the  purpose  of  selected  individual 
data  records: 

(1)  Data  Record  A:  "Operation  and  Maintenance  Requirements."  Pre- 
pared  for  the  system  and  for  each  subsystem  for  which  mainte¬ 
nance  requirements  are  to  be  imposed;  it  is  also  prepared  for 
Government-furnished  equipment.  The  record  documents  system 
maintenance  requirements  and  further  documents  the  allocation  of 
those  requirements  to  lover  indenture  repairables.  Record  A  data 
are  provided  by  the  Government  activity  and  nay  be  included  in 
the  solicitation. 

(2)  Data  Record  Bt  "Item  Reliability  (R)  and  Maintainability  (M) 
Characteristics."  This  record  describes  the  functions  of  the 
end  item,  outlines  the  maintenance  concept  to  be  utilized  for 


design  and  support  planning  purposes*  and  identifies  any  design 
conditions  such  as  fail-safe  requirements  and/or  environmental 
or  nuclear  hardness  considerations  imposed  upon  the  system.  The 
record  summarizes  the  reliability,  maintainability,  and  related 
availability  characteristics  of  the  item  resulting  from  the 
failure  modes  and  effects,  criticality,  and  maintainability 
analyses  documented  on  the  B1  and  B2  Data  Records.  A  separate  B 
record  is  prepared  for  the  system,  for  each  subsystem  contained 
in  the  system,  and  for  each  lover  level  for  that  subsystem  until 
the  lowest  reparable  item  has  been  documented.  The  degree  of 
breakdown  shall  be  specified  by  the  requiring  authority. 

(3)  Data  Record  C;  "Operation  and  Maintenance  Task  Summary."  The 
Operation  and  Maintenance  Task  Summary  record  is  used  to 
consolidate  the  operations  and  maintenance  tasks  identified  for 
each  reparable  assembly  and  indicates  necessary  support  require¬ 
ments  (e.g.,  facilities,  training  equipment,  tools,  and  support 
equipment).  Detailed  analyses  of  the  tasks  identified  on  the  C 
Records  are  provided  on  the  D  Records.  C  Data  Records  are 
completed  to  the  same  indenture  level  as  the  B  Data  Records. 

(4)  Data  Record  Pi  "Operation  and  Maintenance  Task  Analysis."  The  D 
Data  Record  provides  a  detailed  step-by-step  narrative  descrip¬ 
tion  of  how  tasks  identified  on  the  C  Record  are  to  be  perform¬ 
ed,  the  specific  Air  Force  specialty  (APS)  and  skill  level 
recommended,  and  applicable  task  times  (manhours  and  elapsed 
time).  Data  on  the  D  Record  provide  information  necessary  for 
the  development  of  technical  publications  and  personnel 
requirements.  The  D  Record  data  vill  be  initiated  during 
detailed  system/equipment  design.  For  all  operational  and 
maintenance-level  tasks,  specific  requirements  for  the  comple¬ 
tion  of  the  D  Record,  hardvare  items,  and  indenture  levels  vill 
be  as  specified  by  the  requiring  authority.  D  Data  Records  are 
completed  for  each  task  documented  on  Data  Record  C. 

(5)  Date  Record  Pit  "Personnel  and  Support  Requirements."  The  D1 
Data  Record  provides  recommended  training,  personnel,  support 
equipment,  and  supply  support  requirements  necessary  for  the 
accomplishment  of  the  individual  tasks  described  on  Data  Record 
D.  During  the  detailed  system/equipment  design,  the  data  record 
vill  be  initiated  for  each  task  identified  on  Data  Record  C. 
Man-hours  and  elapsed  tine  are  also  recorded  on  the  Data  Record 
Dl. 

(6)  Data  Record  E:  "Support  Equipment  or  Training  Material  Descrip- 
tion  and  Justification."  Unless  otherwise  specified,  this  data 
record  is  structured  to  consolidate  the  pertinent  information 
related  to  existing  or  nev  support/test  equipment  or  training 
material.  The  E  Data  Record  serves  as  identification  of  and 
justification  for  all  hardvare  and  softvare  elements  required  to 
conduct  off-line  test. 


2.9  LSAR  REPORTS 

A.  A  large  number  of  reports  are  available  through  the  Joint-Service 
LSAR  ADP  program  and  will  also  be  available  using  the  UDB2000  system. 
These  reports  comprise  one  of  the  principal  benefits  of  the  LSA/LSAR 
process  and  should  be  of  much  use  to  the  training  communities.  Some 
examples  of  reports  deemed  helpful  in  training  development,  and  their 
related  OIDs,  are  listed  below.  Additional  DIDs  for  training 
purposes  are  listed  in  paragraph  3.5(J)  of  this  report. 

Report 


number 

Report  title 

DID  number 

LSA-001 

Direct  Annual  Maintenance  Man-hours  by  Skill 
Specialty  Code  and  Level  of  Maintenance 

DI-L-7146 

LSA-002 

Personnel  and  Skill  Summary 

DI-L-7147 

LSA-011 

Requirements  for  Special  Training  Device 

DI-L-7155 

LSA-014 

Training  Task  List 

DI-L-7158 

LSA-015 

Sequential  Task  Description 

DI-ILSS-80115 

LSA-022 

Referenced  Task  List 

DI-L-7163 

LSA-075 

LSAR  Manpover  Personnel  Integration 
(MANPRINT)  Summary 

DI-ILSS-80290 

The  Training  Task  List  report,  vhich  lists  tasks 

by  Air  Force 

specialty  code  (AFSC),  is  used  exclusively  for  training  purposes. 
The  report  can  be  used  to  recommend  tasks  for  training  and  provide  a 
basis  for  recommending  training  locations. 

C.  To  show  the  relationships  among  the  LSAR  data  records,  the  LSAR 
reports,  and  Data  Item  Descriptions,  a  flow  diagram  is  presented  as 
Figure  2.  This  diagram  depicts  the  use  of  selected  LSAR  records, 
containing  data  elements  which  are  formatted  in  numbered  LSAR 
reports.  These  reports  contain  key  information  for  the  manpower, 
personnel,  and  training  (MPT)  community. 

D.  New  reports  are  being  developed  as  a  result  of  Service  recommenda¬ 
tions  to  the  Joint  Service  LSA  Working  Group,  which  is  chaired  by  the 
Army  Materiel  Readiness  Support  Activity  (MRSA)  at  Lexington, 
Kentucky. 


III.  STUDY  REVIEW  AMD  FINDINGS 


3.1  APPROACH 

A.  The  study  effort  encompassed  a  thorough  examination  of  the  available 
methods  for  determining  training  needs  and  training  models,  and  other 
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Figure  2.  LSAR  Data  Flow  for  MPT 
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aethods  and  procedures  used  vithln  the  training  area  in  system 
acquisition.  An  assessment  vas  made  of  the  standard  contract  data 
items  referenced  by  MIL-STD-1388-2A  used  in  training  development.  In 
addition  to  a  literature  reviev,  this  process  involved  discussions 
with  various  offices  which  included  SPOs,  ASD,  Air  Force  Acquisition 
Logistics  Center  (AFALC),  ATC,  and  selected  contractors.  Also,  an 
evaluation  vas  conducted  at  our  request  by  the  3306  TES.  The  reviev 
also  focused  on  the  ISD  process  and  the  application  of  the  UDB  for 
training  during  system  acquisition. 

B.  Useful  and  supplemental  data  elements  in  the  military  standard  were 
revieved;  and  data  elements  required  to  produce  any  new  LSAR  data 
records  for  training  requirements  were  to  be  defined.  An  evaluation 
of  the  procedures  for  handling  the  data  within  the  UDB2000  vas  made. 


3.2  MODELS/METHODS  IN  USE 

A.  ISD  is  the  required  process  for  developing  Air  Force  training,  as 
defined  in  AFR  50-8.  It  is  a  model  of  five  broad  steps  that  vill  be 
used  for  decision  making  regarding  education  and  training  programs 
needed  for  a  new  weapon  or  support  system.  The  requirement,  then, 
must  start  during  the  conceptual  development  stage  and  continue 
throughout  the  life  of  the  system.  The  process  also  calls  for 
responsible  offices  to  match  anticipated  instructional  requirements 
with  needs  and  thus  develop  budget  proposals  for  instructional 
programs.  An  interface  between  the  Planning,  Programming  and 
Budgeting  System  (PPBS)  and  the  ISD  process  to  fulfill  these 
requirements  is  also  needed. 

B.  In  addition  to  the  applicability  of  ISD  for  acquisition  programs,  AFR 
50-8  also  mandates  the  process  for: 

(1)  Air  Force  educational  programs  (i.e.,  professional  development, 
management,  and  leadership  courses). 

(2)  Existing  education  and  training  programs. 

(3)  Training  associated  with  an  Air  Force  specialty  or  system  (e.g., 
OJT,  correspondence  training,  and  aircrev  training). 

C.  The  3306  TES  has  developed  a  14-step  adaptation  of  the  Air  Force  five 
5-atep  ISD  model.  Their  procedure  provides  an  orderly  process  for 
planning  and  developing  training  and  training  equipment  requirements. 
A  comparison  of  the  3306  TES  model  to  the  Air  Force  model  is  shovn  in 
Figure  3. 

3.3  INTERFACE  OF  ORGANIZATIONS 

A.  A  number  of  organizations  interact  in  the  acquisition  process.  The 
Program  Manager  (PM)  in  the  SP0  is  the  key  individual,  being 
responsible  for  the  overall  management  and  ensuring  of  communication 
and  coordination  of  goals  among  all  participants.  SP0  management 
coordinates  the  activities  of  the  using  major  command  (MAJC0M),  Air 
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Force  Logistics  Command  (AFLC) ,  AFALC,  AFOTEC,  and  ATC.  The  PM  is 
responsible  for  consolidating  and  issuing  all  documentation,  to 
include  the  Prograa  Review  Package  (PRP),  Integrated  Logistics 
Support  Plan  (ILSP),  and  the  Integrated  Support  Plan  (ISP).  The  SPO 
also  has  the  overall  responsibility  for  carrying  out  the  training 
development  prograa  necessary  to  support  its  acquisition  prograa. 

B.  Although  the  SPO  handles  the  day-to-day  management  of  the  veapon 

system  and  its  support  elements  to  include  the  procurement  of 
maintenance  training  devices,  the  Simulator  SPO  (SIMSPO)  currently 
manages  the  development  and  acquisition  of  aircrev  training  devices. 
A  vorking  agreement  is  usually  reached  betveen  the  two  SPOs  to  define 
the  specific  tasks  and  responsibilities  of  each.  Thus,  the  SIMSPO 
assumes  a  role  somewhat  parallel  to  the  weapon  SPO  in  that  the 
activities  of  cost,  schedule,  budget,  inputs  to  RPP,  etc.,  must  be 

completed  along  with  the  weapon  system  schedule.  In  essence,  the 
SIMSPO  role  has  been  to  develop  and  ensure  delivery  of  the  needed 
aircrew  training  devices. 

C.  The  interface  continues  with  the  selection  of  the  Deputy  Prograa 

Manager  for  Logistics  (DPML)  or  the  Integrated  Logistics  Support 

Manager  (ILSM)  for  the  development  and  use  of  the  ILSP.  For  a 
less-than-aajor  acquisition  prograa,  the  ISLM  performs  a  similar  role 
to  that  of  the  DPML.  The  ILSP,  when  developed,  sets  the  stage  for  a 
manageable  prograa  that  will  integrate  prograa  planning,  engineering, 
design,  test  and  evaluation,  production,  and,  finally,  operation  of 
the  system.  Support  for  training  development  is  provided  to  the  SPO 
by  AFALC  in  the  fora  of  requirements  reviev  for  the  SOW  and  RFP. 
Thus,  AFALC  revievs  program  documentation  to  ensure  that  training 
considerations  are  included  along  with  manpower  and  personnel 
requirements  in  contractor  taskings. 

D.  The  using  MAJCOM  is  tied  to  the  process  in  that  it  provides  qualified 
personnel  needed  to  support  the  1LS  planning  through  implementation 
of  policies  and  procedures.  The  using  command  must  also  provide  and 
update  the  operational  and  maintenance  concepts  as  the  acquisition 
prograa  moves  along.  Their  involvement  in  the  training  development 
effort  begins  vith  their  recommendations  of  AFSCs  and  the  tasks  to  be 
applied.  In  some  cases  (e.g.,  a  major  prograa),  the  using  command 
may  assign  an  analyst  to  work  temporarily  vith  the  SPO  on  training 
development.  However,  this  is  the  exception;  usually  a  SPO  member  is 
assigned  this  duty. 

Although  ATC  is  involved  in  planning  of  training  support  for  a  new 
veapon  system  from  the  initial  SOV  through  the  end  of  the  system's 
operational  life,  the  SPO  is  responsible  for  and  initiates  training 
development  planning.  This  is  accomplished  through  the  establishment 
of  the  TPT  and  the  subsequent  creation  of  a  TOP.  The  SPO  focal  point 
usually  chairs  the  TPT  meetings.  These  meetings  are  attended  by  a 
multi command  staff  of  people  vho  have  the  responsibility  for  planning 
the  training  requirements  for  the  life  of  the  veapon  system.  The  plan 
should  address  all  the  training  needs,  schedules,  AFSCs,  issues,  etc. 
for  a  total  training  prograa.  The  plan  is  prepared  under  the  provi¬ 
sions  of  AFR  50-8  and  AFR  50-11,  usually  concurrently  vith  the  system 


design  review  or  shortly  after  Full-Scale  Development  (FSD)  begins. 

Thus,  the  TDP  is  currently  not  a  timely  document  in  the  acquisition 
process.  Development  of  the  TDP  is  a  very  important  event.  ATC  may 
provide  trained  specialists  to  the  SPO  as  management  deems  necessary, 
and  as  is  consistent  vith  the  role  and  evaluation  of  the  ATC  Training 
Advisory  Office  at  the  APSC  Division  level. 

HQ  ATC  is  a  key  organization  in  the  development  of  maintenance 
training,  and  they  must  ensure  the  establishment  of  policy  and  direc¬ 
tives  to  this  end.  Maintenance  training  system  development  is  usually 
assigned  to  one  of  the  Technical  Training  Centers  (TTCs)  or  to  the 
TES.  HQ  ATC  also  managts  the  efforts  of  Field  Training  Detachment 
(FTD)  personnel  regarding  course  instruction  and  use  of  the  training 
devices.  The  TTC  has  the  responsibility  of  planning,  instructor 
staffing,  and  curriculum  development  of  their  respective  resident 
maintenance  training  courses.  In  addition,  they  may  be  tasked  to 
assist  in  the  ISD  process  and  in  the  training  system  development  and 
design  revievs.  TTC  personnel  must  also  be  involved  vith  the  using 
MAJCOM's  maintenance  and  training  personnel  to  gain  an  understanding 
of  the  weapon  system  maintenance  concept  in  use. 

E.  The  Air  Force  has  recognized  the  need  for  increased  emphasis  on  MPT 
requirements  earlier  in  the  weapon  system  acquisition  process. 

Tovard  this  end,  an  MPT  Directorate  has  been  established  within  the 
Aeronautical  Systems  Division,  Deputy  for  Acquisition  Logistics 
(ASD/AL).  Better  analysis  and  integration  of  MPT  requirements  within 
the  program  offices  are  anticipated.  This  directorate  will  serve  an 
extremely  important  role  in  formalizing  all  MPT  activities  within  the 
SPOs.  At  present,  training  requirements  development  lacks  the  needed  { 

direction  to  ensure  that  all  necessary  events  are  planned  for  and  ! 

controlled.  Individual  SPOs  are  not  always  consistent  or  thorough  in 
their  efforts  to  ensure  that  needed  training  and  training  devices  are 
available  in  time  to  meet  IOC.  This  is  said  not  to  fault  any  individ¬ 
uals  or  managers  but  rather,  to  point  out  the  previous  lack  of  a  i 

central  responsible  body  vith  the  resources  needed  to  enhance  and  j 

ensure  a  compatible  effort  vithin  the  program  office.  j 

f 

The  nev  MPT  Directorate  vlll  develop  this  needed  capability.  MPT  ! 

analysts  will  be  available  to  advise,  assist,  and  provide  such 
services  and/or  information  as  technical  information,  analytical  i 

models,  and  information  systems.  In  addition,  maximum  use  can  be  I 

made  of  existing  methods  and  models;  for  example  LSA,  LSAR  records 
and  reports,  and  Logistics  Composite  Model  (LCOM)  and  other  model  j 

products  can  become  established  media  for  all  program  offices.  It  is 
important  to  note  here,  that  the  purpose  of  MPT  analysis  and 
integration  is  to  quantify  MPT  impacts  on  individual  veapon  systems, 
both  current  and  planned.  Thus,  a  means  exists  for  adopting  nev 
procedures  or  systems  from  which  individual  SPOs  have  benefited  in  i 

working  vith  their  prime  contractors  or  subcontractors.  An  example  J 

is  the  McDonnell  Aircraft  Company's  CLASS  system  for  providing  LSAR  , 

records  and  data.  The  F-1SE  and  C-17  SPOs  vere  able  to  establish 
terminal  hook-up  vith  McDonnell  Aircraft  Company  and  McDonnell 
Douglas  Corporation  to  enhance  the  receipt  of  needed  data  elements. 
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MPT  personnel  will  have  visibility  across  programs,  and  the  capa¬ 
bility  to  support  SPO  objectives,  especially  during  initial  or  high 
vorkload  events,  such  as  front-end  analysis,  SOW  and  RPP  preparation, 
and  program  review.  The  MPT  Directorate  will  have  the  following 
responsibilities: 

Ensuring  MPT  analysis  and  integration  along  with  system  devel¬ 
opment  in  acquisition  programs. 

Establishing  a  structured  process  for  accomplishment  of  MPT 
tasks  on  acquisition  programs,  including  application  of  uni¬ 
form  procedures  and  standards  for  MPT  analysis  and  integra¬ 
tion. 

Establishing  an  MPT  decision  support  system  which  includes 
life-cycle  cost  and  cost-effectiveness  data  bases  and  models. 

Ensuring  that  program  management  responsibility  transfer  and 
planning  for  fielding  of  the  system  address  MPT. 

Establishing  a  process  to  ensure  that  program  reviews  include 
assessment  of  MPT  issues  and  concerns. 

Finally,  the  MPT  Directorate  will  work  on  developing  a  contractual 
language  that  will  ensure  that  MPT  requirements  are  thoroughly 
included  and  evaluated  in  the  source  selection  process. 

In  effect,  the  nevest  member  of  the  interfacing  organizations  vill 
provide  increased  emphasis  and  direction  upon  the  integration  of  MPT 
elements  into  the  weapon  system  acquisition  process.  This  is  an 
important  development  for  ensuring  that  the  training,  planning, 
requirements  analysis,  and  training  equipment  development  and  produc¬ 
tion  are  effectively  planned,  coordinated,  and  funded  for  each  new  or 
planned  system. 

F.  Figure  4  provides  a  graphic  representation  of  the  organizational 
interfaces.  The  lines  linking  organizations  involved  in  training 
development  need  not  be  considered  limiting  in  terms  of  communication 
and  coordination.  Also,  it  should  be  noted  that  though  the  PH  has 
management  responsibility  for  ISO  application,  it  is  the  responsi¬ 
bility  of  the  3306  TBS  or  contractor  to  apply  the  ISD  process. 

3.4  CASE  STUDY  OF  F-15  TRAINING  DEVELOPMENT 

A.  The  process  of  an  ISD  effort  changes  over  the  life  of  a  weapon 
system.  An  example  is  the  F-15  aircraft,  vhose  initial  ISD  was  done 
by  test  and  evaluation  personnel  and  selected  FTD  instructors  using 
an  elementary  ISD  process  current  at  that  time.  This  ISD  team 
identified  the  courses  required  to  maintain  the  F-15,  and  those  Type 
1  training  courses  specified  by  the  team  and  the  initial  test  team  at 
Edvards  AFB.  This  effort  provided  the  FTD  courses  necessary  to 
establish  an  in-house  capability  to  train  F-15  maintenance  personnel. 
During  this  same  period,  the  ISD  process  also  identified  the  needed 
maintenance  training  devices. 


Training  Development  in  Acquisition 


In  th«  following  years,  as  the  F-15  evolved  and  new  courses  were 
required,  the  ISO  was  performed  by  the  FTD  responsible  for  developing 
the  courses.  In  this  manner,  ISD  responsibility  shifted  from  test 
and  evaluation  personnel  to  field  training  personnel  and  finally  to 
the  appropriate  TTC  responsible  for  teaching  the  resident  course. 

The  current  TDP,  Annex  1  F-1SE,  does  not  require  a  new  ISO  process 
since  the  E-aodel  is  a  derivative  of  the  basic  aircraft.  Thus, 
current  aaintenance  training  courses  are  to  be  reviewed  and  updated 
to  reflect  changes  required  by  the  new  configuration.  Aircraft 
Maintenance  Training  (AMT)  and  Mechanical  Trainers  (i.e.,  hardware 
systea  trainers  and  systeas  equipaent  groups)  are  to  be  provided. 
These  will  be  developed  based  upon  the  LSAR  data  and  Task  Analysis 
performed  under  contract  in  compliance  with  MIL-STD-1388-2A.  Under 
direction  of  the  SPO,  training  development  vill  include: 

Aircraft  Maintenance  Trainers  -  computer-controlled  simulation 
systeas  that  provide  organizational-level  training  on  specified 
procedures  for  fault  isolation,  adjustment,  and  remove  and 
replace  aaintenance  actions. 

Mechanical  Trainers  -  hands-on  training  devices  using  actual 
aircraft  hardware  and  ground  support  equipaent  to  train  mainte¬ 
nance  personnel  in  a  controlled  environment.  They  will  be  used 
to  teach  system  operation,  component  location,  troubleshooting, 
rigging,  and  remove  and  replace  procedures. 

Type  1  Maintenance  Training  -  Type  1  training  is  formal  training 
conducted  by  contractors  under  APR  50-9  and  can  be  conducted  at 
the  contractor's  location  or  at  an  Air  Force  Base.  Projected 
training  includes  courses  for: 

AFSC  326x6  Integrated  Avionics  Attack  Control  Systems 

3-week  course 

AFSC  326x7  Integrated  Avionics  Instrument  and  Flight 

Control  Systems  2-week  course 

AFSC  326x8  Integrated  Avionics,  Communications,  Naviga¬ 
tion,  and  Penetration  Aids  Systems 

3-week  course 

AFSC  42371  Aircraft  Environmental  Systems  1-veek  course 

AFSC  43171  Tactical  Aircraft  Maintenance  8-day  course 

AFSC  46270  Aircraft  Armament  Systems  3-veek  course 

It  is  appropriate  to  briefly  mention  training  equipment  acquisition. 
The  needed  maintenance  training  equipaent  includes  the  aircraft 
maintenance  trainers,  mechanical  trainers,  and  other  devices  used  for 
in-residence  training  and  for  mobile  training  given  at  base  level. 
Requirement  identification  is  the  responsibility  of  ATC,  and,  when 


known,  is  provided  to  the  SPO  for  funding  action.  After  equipment 
delivery  to  ATC,  the  program  responsibility  is  transferred  to  the 
proper  Air  Logistics  Center  (ALC).  The  ALC  provides  logistics  sup¬ 
port  for  the  equipment  in  terms  of  funding  and  procuring  replen¬ 
ishment  spares  and  repair  parts,  and  also  through  the  provisioning 
for  initial  spares,  repair  parts  and  support  equipment  in  time  to 
meet  training  milestones. 

E.  Under  the  basic  F-1S  TDP,  ASD  and  the  SPO  provide  overall  management 
for  the  acquisition  and  integration  of  the  training  requirements. 
Planning  and  control  are  accomplished  through  the  TPT,  vho  estab¬ 
lishes  and  maintains  program  training  goals.  Training  plan  progress 
is  reviewed  at  quarterly  ILS  Management  Team  reviews  conducted  by  the 
SPO.  Any  program  redirections  are  evaluated  in  terms  of  training 
requirement  impact.  ATC  is  responsible  for  a  major  part  of  the 
overall  training  acquisition  as  the  basic  P-15  TDP  states  that  ATC 
will: 

Identify  the  training  devices  and  participate  in  TPT  decisions. 

Conduct  and  manage  the  maintenance  ISO  analysis  to  provide 
needed  information  to  ASD  and  the  user  command. 

Act  as  the  sole  procurement  activity  for  all  Type  I,  formal 
contractor  training. 

Participate  in  specification  reviews,  RFP  preparation,  source 
selection,  preliminary  and  critical  design  reviews,  acceptance 
fating,  technical  order  reviews  and  verifications,  and  main¬ 
tainability  demonstrations. 

Provide  formal  Air  Force  maintenance  training. 

F.  Training  development  in  acquisition  is  an  approach  to  provide  for  a 
complete  training  system,  including  the  needed  trainers,  training 
devices  and  technical  materials  required  to  conduct  all  training. 
The  F-15  TDP  and  the  associated  F-15E  annex  plans  are  viable  doc¬ 
uments  outlining  the  training  concept  and  training  responsibilities. 
This  is  a  result  of  the  combination  of  the  individual  planning 
efforts  of  all  the  interfacing  organizations. 

G.  Although  these  plans  point  to  the  use  of  the  ISD  process  in  training 
development,  they  make  no  reference  to  the  application  of  LSAR  data 
under  MIL-STD-1388-2A.  Training  planning  should  include  the  require¬ 
ment  for  LSA  tasking  and  the  subsequent  LSAR  tailoring  process.  This 
may  well  be  contained  in  the  ILSP;  however,  the  Statement  of  Opera¬ 
tional  Need,  Program  Management  Directive,  maintenance  concept, 
schedules,  etc.  must  relate  to  training  development  in  the  form  of 
data  requirements.  In  that  the  LSAR  data  are  directly  tied  to  the  end 
item  being  procured,  so  lies  the  need  for  proper  selection  of  data 
elements.  The  TDP  should  be  expanded  to  capture,  as  a  minimum,  those 
DIDs  for  training  data  required  to  be  furnished  by  the  contractors. 


3. S  CONTRACT  TRAINING  DEVELOPMENT 


A.  Whether  determination  of  training  needs  is  done  in-house  or  by 
contract,  training  requirements  are  alvays  determined  through  an 
analysis  of  tasks  necessary  to  complete  a  job  action.  Tasks,  then, 
must  be  stated  in  terms  of  vhat  students  must  be  able  to  accomplish 
as  a  direct  result  of  the  training  experience.  This  action  forms  the 
basic  starting  point  in  developing  training  courses  and  equipment 
training  devices. 

B.  The  present  investigation  identified  three  approaches  to  training 
development  currently  in  use. 

Use  of  a  generic  approach  based  on  similar  program  tasks,  steps, 
and  skills/knovledge  listings. 

Contractual  development  of  tasks,  steps,  and  skills/knovledge 
based  on  engineering  data,  with  tailoring  by  training  special¬ 
ists. 

In-house  development  by  trained  ISD  personnel  of  task,  steps, 
and  skills/knovledge  based  upon  generic  listings,  LSAR  data,  or 
other  contractor  furnished  data. 

It  should  be  noted  that  seldom  are  any  of  these  databases  complete. 
Thus,  subject-matter  specialists  (SMSs)  must  vork  vith  contractor 
design  personnel,  engineering  dravings,  available  LSAR  data,  and 
other  existing  technical  data  to  develop  the  tasks  and  subtasks  (see 
Figure  5). 

C.  The  B-1B  SPO  initiated  a  contract  to  develop  an  analysis  of  the 
necessary  veapons  release  system  and  veapons  loading  training 
required  at  the  organizational  level  to  meet  the  goals  of  the  B-1B 
armament  system  technical  training  program.  Contractor  analysts  began 
their  effort  by  defining  the  basic  jobs  and  duties  anticipated  on  the 
B-1B  aircraft  for  AFSC  462X0,  Armament  System  Technician.  They 
developed  a  job  list  vhich  contained  nearly  500  tasks  in  the  tvo  job 
areas  of  veapons  loader  and  release  system  technician.  They  vorked 
vith  Air  Force  SMSs  to  complete  an  initial  task  list.  The  analysts 
examined  all  tasks;  grouped  then  by  common  elements  of  skills, 
components,  etc.;  and  made  recommendations  under  an  established 
training  concept.  This  training  concept  centered  around  the  delivery 
of  the  training,  the  philosophy  about  the  training  structure  (e.g., 
instructional  goals,  objectives,  integration  of  media  and  training 
hardvare,  etc.),  and  the  training  environment. 

D.  The  analysis  process  vas  also  based  on  the  concepts  in  AFM  50-2  and 
AFP  50-58  as  expanded  and  modified  by  the  AFHRL  Maintenance  Trainer 
Design  and  Acquisition  Handbook  of  ISD  Procedures  for  Design  and 
Documentation.  A  computer  application  vas  used  to  control  and  manage 
the  process  and  gained  the  benefits  of: 
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Figure  5,  ISD  Training  Analysis  -  Present  Procedure  (Page  1) 
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Figure  5.  Other  Data  Input  to  ISD  (Page  3) 
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Reduction  in  analysis  time, 

Tracking  of  relationships  of  tasks,  steps/activities,  and 
skills/knovledge, 

Ease  of  formatting  results, 

Separating  of  hardware  from  non-hardware  tasks,  and 
Developing  the  training  device  requirements. 

E.  This  process  yielded  a  training  device  requirement  or  required 
training  system  description  for  each  task  or  task  grouping,  and 
served  to  provide  the  initial  design  of  the  needed  training  device. 
The  final  design  was  completed  through  a  review  by  the  contractor  and 
Air  Force  SNEs  and  managers. 

F.  The  decision  on  training  requirements  under  the  above  process  or 
other  ISD  processes  is  not  based  on  a  model,  but  upon  the  collective 
judgment  of  technicians,  analysts,  and  managers. 

G.  HIL-STD-1379B  also  provides  guidance  for  training  course  development 
under  contractual  agreement.  The  development  process  requires  the 
contractor  to  use  an  ISD  event-sequencing  method.  Further,  the 
standard  explicitly  requires  that  a  training  conference  be  held 
within  60  days  after  contract  start  date.  It  is  intended  that  the 
contractor  present  a  detailed  training  program  plan  using  LSAR  data, 
engineering  drawings,  and  other  available  data  to  define  and  support 
the  training  outline.  This  review  serves  both  Government  and 
contract  personnel  as  a  means  to  refine  and  agree  upon  detailed 
training  requirements.  Foraal  minutes  are  prepared  by  the  contractor 
to  record  all  decisions  and  agreements. 

H.  Appendix  A  of  the  standard  lists  applicable  DIDs  for  training  data 
which  nay  be  placed  on  CDRLs  as  needed.  This  standard  is  not  intended 
to  duplicate  other  efforts,  as  data  developed  under  other  contract 
requirements  should  be  utilized  to  fulfill  needs. 

I.  The  Manpower,  Personnel  and  Training  Analysis  Report,  DI-ILSS-80077, 
illustrates  the  use  of  data  directly  from  LSAR  for  training  purposes. 
Under  a  total  LSAR  program,  data  elements,  including  codes  and 
definitions,  should  be  available  to  complete  this  report.  For  those 
acquisition  programs  not  on  contract  for  a  total  LSA  program, 
generation  of  data  will  be  limited  to  those  elements  of  data  unique 
to  the  DID.  The  standard  also  states  that  duplicate  effort  is  prohib¬ 
ited  for  the  development  of  data  applicable  to  two  or  more  DIDs. 
DI-ILSS-80077  is  designed  to  show  the  technical  tasks  performed  by 
operator  and  maintenance  personnel,  job  descriptions,  and  manpower 
requirements  necessary  for  the  proper  operation,  maintenance,  and 
repair  of  system  and  equipment.  The  report  lists  skills  needed, 
frequency  of  task  performance,  time  required  to  perform  tasks, 
personnel  requirements,  and  location  and  description  of  task  steps. 
This  DID  should  be  applied  to  Development/Production-phase  contracts. 


] 


Completion  of  the  DID  will  provide  the  program  office  detail  within 
the  following  areas: 


System  and  equipment  introduction  and  description,  providing 
information  relevant  to  tKe  operational  and  maintenance 
concepts. 

Job  task  analysis  summary,  providing  a  description  of  each  task 
needed  to  operate  and  maintain  the  system  and  equipment,  and  the 
related  personnel  data  requirements. 


Job  training  task  list,  providing  a  breakout  of  the  task 
behavioral  elements,  conditions  under  which  the  tasks  must  be 
performed,  task  performance  standards,  and  tasks  for  which 
training  is  to  be  provided. 


Manpower  planning  data,  providing  the  number  of  personnel 
required  to  operate  and  maintain  the  system  and  equipment. 

Manpower  summary,  listing  the  operator  and  maintenance  quantita¬ 
tive  manpower  requirements,  by  personnel  specialties  and  skill 
levels  required  to  perform  the  tasks  at  all  levels  except  depot. 

Job  training  analysis  matrix,  listing  the  subsystems/equipments 
which  comprise  the  system,  the  tasks  to  be  performed,  and  the 
knowledge  required  to  perform  the  tasks. 

Training  analysis  summary,  providing  the  learning  objectives  and 
the  skills  and  knowledge  required  to  perform  the  tasks. 


J.  The  following  data  requirements  may  be  placed  on  contract  as  needed 
by  the  SPO: 


Data  Requirement 

Training  and  Training  Equipment  Plan 
Training  Courses  Proposal 
Task  Skill  Analysis  Report 
Training  Courses/Curriculun  Outline 
Ins  true tor/Lesson  Guides-Training  Courses 
Student's  Training  Course  Guide 
Audiovisual  Aids,  Master  Reproducibles 
and  Review  Copies  for  Training 
Equipment  and  Training  Courses 
Audiovisual  Aids  Index  for  Training 
Equipment  and  Training  Courses 
Tests  for  Measurement  of  Student 
Achievement 

Student  and  Training  Course  Evaluation 
Forms 

Instructors  Utilization  Handbook  for 
Simulation  Equipment 
On-the-Job  Training  Handbook 
Technical  Hands-on-Training  System 
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DI-H-7066 

DI-H-7067 

DI-ILSS-80076 

DI-H-7068 

DI-B-7069 

DI-H-7070 
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DI-H-7072 
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DI-H-7073 

DI-H-7074 

DI-H-7075 

DI-H-7076 

DI-H-7077 

DI-B-7078 
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Data  Requirement 


Conference  Agenda 

Conference  Hinutes 

Training  Path  System  Documentation 

Personnel  Performance  Profiles 

Curriculum  and  Instructional  Media 
Materials 

Factory  Training  Curriculum  Materials 

LSA-075,  LSAR  Manpower,  Personnel 
Integration  (MANPRINT)  Summary 

*  New  DIDs  approved  December  10,  1985. 

**  Title  is  Manpower,  Personnel  and  Training  Analysis  Report. 

3.6  STANDARD  CONTRACT  DATA  ITEMS 

A.  An  applied  LSA  tailoring  strategy,  which  identifies  task  outputs  and 
projects  task  requirements  for  succeeding  program  phases,  is  shown  in 
the  ILS  Plan.  Normally,  any  interfaces  between  the  LSA  program  and 
other  system  engineering  analysis  are  also  described  in  the  plan. 
Thus,  both  engineering  and  ILS  functional  element  requirements  and 
analysis  can  be  used  for  DID  selection  purposes.  Technical  data 
needed  to  support  an  ILS  program  are  standardized  and  listed  on  the 
LSAR  data  records  per  the  contractual  agreements.  As  previously 
indicated,  the  initial  step  involves  selection  of  the  analysis  tasks 
and  the  subsequent  flow  of  data  onto  the  LSAR  record  for  purposes  of 
recording,  storing,  and  processing  (see  Figure  6).  This  collection 
of  data  or  LSA  documentation  may  equal  that  developed  and  documented 
in  the  system  engineering/design  process.  Changes  in  program 
concepts,  requirements,  or  schedules  should  be  incorporated  as  they 
occur.  Even  though  system  engineering/design  data  are  available  at 
the  contractor  facility,  the  responsible  program  office  should  ensure 
the  completion  of  Data  Record  A  based  on  the  tasks  of  MIL-STD-1388-1A 
and  so  specify  this  requirement  in  the  solicitation. 

B.  The  DIDs  can  be  revieved  to  match  the  data  element  requirements;  that 
is,  the  relationship  betveen  the  LSAR  records  and  associated  DID  can 
be  examined  in  detail,  down  to  the  needed  data  elements.  Table  IV  of 
MIL-STD-1388-2A  provides  a  listing  of  the  more  common  DIDs.  As  an 
example.  Figure  7  makes  a  comparison  betveen  LSAR  and  tvo  of  these 
DIDs:  DI-H-7057,  Hunan  Engineering  Design  Approach  Document  Main- 
tainer,  and  DI-H-7068,  Task  and  Skill  Analysis  Report.  In  addition,  a 
determination  as  to  vhether  LSAR  reports  can  be  used  to  satisfy  a  DID 
may  be  made  by  looking  at  MIL-STD-1388-2A,  Figure  90,  which  shovs  the 
input  data  elements  required  for  the  reports  (see  Figure  8).  This 
review  process  will  provide  the  specific  data  elements  and  LSAR 
records.  Based  on  this  review,  the  DD  Form  1949-1,  LSAR  Data  Selec¬ 
tion  Sheet,  can  be  compiled  to  make  up  the  total  LSAR  data  require¬ 
ments.  See  Figure  9  for  an  example  of  the  selection  sheet. 

C.  To  be  useful  in  the  training  development  effort,  LSAR  data  must  also 
be  timely.  It  is  important  that  the  SPO  establish  schedule  comple¬ 
tion  dates  for  the  data  products  that  utilize  LSAR  data.  MIL-STD- 


DID  No. 


★New  DID 


DI-H-7088 

DI-A-7089 

DI-H-7090 

DI-H-7901 

DI-H-7092 


DI-ILSS-80079 

DI-ILSS-80078 


DI-H-7093 

DI-ILSS-80290 


Figure  7.  Data  Item  Description  (DID)  Relationships  to  the  LSAR 
Source:  MIL-STD-1388-2A,  20  July  1984  and  Notice  1,  14  February  1986  (Table  IV) 


•  «M«  tltatMi  •  •*•>«•«  («  »•■<««•  •  ■«*!•< •  m»«l  Figure  8.  LSAR  Input  to  Report  Matrix 

Source:  MIL-STD-1388-2A,  20  July  1984  and  Notice  1,  14  February  1986  (Figure  90) 
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Figure  9.  LSAR  Data  Selection  Sheet 
Source:  MIL-STD-1388-2A,  20  July  1984  and  Notice  1,  14  February  1986 
(Figure  91) 
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1388-2A  recommends  that  the  required  delivery  dates  for  DID 
deliverables  be  established  along  with  the  solicitation  package. 
From  this,  then,  the  delivery  dates  for  the  LSAR  data  records  can  be 
determined.  On  several  acquisition  programs,  the  LSAR  came  too  late. 
The  B-1B  and  T-46  are  two  recent  examples.  In  one  case,  the  3306  TES 
could  not  meet  their  ISD  schedules  because  of  having  to  wait  on 
projected  LSAR  data  because  the  contractor  was  using  the  engineering 
and  related  data  sources.  Deliverable  LSAR  data  have  in  many  cases 
been  included  as  part  of  a  single  data  package  due  upon  completion  of 
the  effort.  These  are  factors  which  contribute  to  LSAR  data  arriving 
late  for  the  ISD  process.  Quoting  in  part  from  Appendix  E,  Figure  6, 
LSAR  Tailoring  MIL-STD-1388-2A,  "scheduling  completion  of  LSAR  data 
must  take  into  account  interim  product  delivery  dates,  final  product 
delivery  dates,  and  schedule  updates  to  final  products.  Each  of  these 
dates  will  impact  the  range  of  LSAR  data  required,  the  depth  of  data 
required  (i.e.,  the  hardware  indenture  levels  and  maintenance  levels 
specified),  and  the  number  of  updates  to  the  LSAR  data  required.  The 
LSAR  completion  schedule  must  then  be  coordinated  with  related 
program  schedules  (i.e.,  drawing  release)  to  ensure  availability  of 
data  for  LSAR  development."  Tables  V  and  VI  of  the  standard  provide 
a  means  to  plan  delivery  dates  or  completion  dates  for  each  data 
record  and  for  LSAR  reports  through  careful  selection  of  the  DIDs 
delivery  dates.  Figure  10  shows  DID  to  LSAR  Record  relationships; 
Figure  11  shows  DID  to  LSAR  Report  relationships. 

D.  Finally,  the  deliverable  LSAR  data  must  be  in  a  usable  form.  For  the 
purposes  of  ISD,  it  must  be  in  printed  format  or  in  a  fora  which 
permits  manipulation  of  the  data.  Ideally,  an  automated  LSAR  system, 
such  as  the  UDB2000,  provides  the  greatest  ability  to  produce  tailor¬ 
ed  products,  respond  quickly  to  on-line  demand,  and  rapidly  access 
reports/suaaaries.  Again,  reflecting  on  the  B-1B  program  effort, 
LSAR  data  were  delivered  in  disc  format  for  use  in  ISD.  However,  the 
data  records/reports  could  not  be  generated  from  the  disc  as  a  result 
of  various  equipment -related  problems.  Unfortunately  delivery  of  the 
disc  product  represented  a  final,  one-step,  contractual  package. 

E.  The  UDB2000,  using  the  Integrated  Data  Management  System  (IDHS)  and 
the  Integrated  Data  Dictionary  (IDD),  maintains  the  relationships 
among  the  data  elements  in  the  database  and  also  provides  a 
centralized  dictionary  in  which  to  define  and  link  together  data 
elements,  records,  and  files.  The  system  has  the  database  logically 
partitioned  by  end  item,  by  contractor,  and  by  agency.  It  affords 
the  LSA  analyst  an  on-line  capability  to  access  the  status  of  the 
LSAR  and  to  ensure  that  data  relationships  are  properly  established 
and  maintained.  Further,  the  system  provides  real-time  calculation  of 
numerous  data  elements.  Elements  are  calculated  at  the  time  screens 
are  displayed,  ensuring  that  the  calculations  are  based  on  the 
current  values  of  the  input  variables.  These  real-time  calculations 
provide  for  automatic  entry  of  data  that  is  dependent  on  other  data 
in  the  system.  As  stated  earlier,  the  data  sheets  and  screens  used 
in  the  UDB2000  system  follow  the  main  divisions  of  the  data  records 
of  MIL-STD-1388-2A. 


37 


N.  Data 
DataS^ecords 
Item  N. 
DescriotioiSw 

A  B  B1  B2  C  DD1  E  El  E2  F  G  H  HI  J 

RnR7RE¥RHHI 

BBBBnnnBBBBBnnaBBIBBB 

1 1 H  W 1  Til  BBnnDDnBIlBBBBBnnBBBBBB 

limiOBH 

■BBDDBnnnBBBBBBBBBB 

BBBUnBnnnBBBBBBBBBa 

iiiBuBW-n 

ill  C2 

BBBDDDBBBflBnnBflBMB 

■.iRaw-f 

iitaaum 

■BBBQQBBBBBQDBBBBBB 

■  III IM  1 1 

□□□BBBBBBBBnnaBBBBB 

inni 


liWAiilitM 

■wnwrai 

WBtSBtiWm 

mwami.'m 

nnBTiim 


ioonannnnnuoi 


inonDi 


!□□□□□■□! 


nnnnnnanaai 

nnnannnnnnnaai 
nnnannonnnnaai 
nnnnanaaaBBnni 

■■■□■□■■■aanni 

KnRinnTmaaaaBaannDaBBHi 


Figure  10.  DID  to  LSAR  Record  Relationships 
Source:  MIL-STD-1388-2A,  20  July  1984  and  Notice  1,  14  February  1986 
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Figure  11.  DID  to  LSAR  Report  Relationships 
Source:  MIL-STD-1388-2A,  20  July  1984  and  Notice  1,  14  February  1986 
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USEFULNESS  OF  LSAR  FOR  TRAINING  DEVELOPMENT 

A.  The  data  recorded  through  the  LSAR  process  become  the  basis  for 
translating  data  into  usable  training  courses  and  devices.  At 
present,  ISD  or  a  form  of  ISD  is  used  to  transform  LSAR  task  data 
into  a  job  task  listing  relating  tasks,  skills,  and  knowledge  levels 
for  training  purposes.  ISD  processes  are  used  by  both  the  Air  Force 
and  contractors. 

B.  An  ISD  approach  used  by  the  McDonnell  Aircraft  Company  to  develop 
a  three-volume  F-1SE  Task  and  Skills  Analysis  Report  illustrates  a 
tailored  procedure  for  the  application  of  LSAR  to  training  develop¬ 
ment.  These  volumes  consisted  of: 


r  Volume  I:  Task  Inventory.  This  volume  specified  the  tasks, 

■  skills,  and  knowledges  required  for  satisfactory  job  perform- 

B  ance.  These,  in  turn,  form  the  basic  criteria  used  in  deter- 

L  mining  training  media,  course  sequencing,  and  objective  format- 

J  ting.  The  tasks,  skills,  and  knowledges  are  developed  by 

,  subject-matter  experts,  complemented  by  their  instructional 

r  designs,  based  on  engineering  and  vendor  technical  data,  LSA 

|  data,  and  prior  experience  on  similar  weapon  systems. 


Volume  II:  Skills  and  Knowledge.  This  volume  listed  the  skills 
and  knowledge  required  to  accomplish  each  task  identified  in 
Volume  I.  Also  shown  is  the  required  training,  such  as 
entry-level  behavior,  study  lessons,  and  hands-on-training. 
The  development  process  provides  a  chronological  listing  of 
tasks,  supporting  skills  and  knowledge,  task  source,  support 
material,  and  training  required  by  duty  area. 

Volume  III:  Training  Analysis  Summary.  This  volume  listed 
suggested  lesson  topics,  individually,  in  the  form  of  a  final  or 
"Terminal"  objective  supported  by  the  "Enabling"  objectives  and 
the  associated  skills  and  knovledge  requirements.  The  lesson  is 
carried  to  a  sub-level  sufficient  to  satisfy  job  performance 
requirements. 
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C.  The  HIL-STD-1388-2A  data  records  are  designed  to  provide  a  logical 
approach  to  documenting  maintenance  task  analysis  and  identifying  the 
associated  skills  needed  to  perform  the  tasks.  Data  Record  D, 
Operation  and  Maintenance  Analysis  (Figure  12)  provides  a  means  to 
record  tasks  in  a  sequential  manner  to  the  desired  maintenance  levels 
identified  by  the  requiring  authority.  Block  5,  Sequential  Task 
Description,  serves  to  document  narratively  in  a  step-by-step  manner, 
all  subtasks  and  task  elements  needed  to  perform  the  task  under 
contractor  engineering  and  design  analysis.  The  tasks  should  be 
documented  in  sufficient  detail,  and  so  sequenced,  to  avoid  any 
technically  incorrect  or  missing  procedures.  The  military  standard 
clearly  states  the  degree  of  documentation  required  on  Data  Record  D. 

D.  Data  Record  Dl,  Personnel  and  Support  Requirements  (Figure  13),  is  a 
further  refinement  of  needs  in  the  analysis  process.  This  record 
identifies  personnel,  training,  support  equipment  and  supply  support 
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TASK  401.2.1 


OATA  ACCOM) 


OTHER  REPORTS? 

lsa  -  003  -  aoa 
-  005  -  020 


LSA  -  001 


OIA .  ANNUAL  MAINT.  M.H. 
BY  A F  SPECIALTY  COOC 


PERSONNEL  AND  SKILL 
LSA  -  002  SUMMARY 


LSA  -  014 


TRAINING  TASK 
LIST 


Providss: 


Initiated : 


Data  So urea: 


Output : 


Pur poos: 


Training,  Paraomal ,  Support  Equlpawnt,  and  Supply  Support  to 
Accoapltah  boil  Task  Shown  on  tha  0  Raoord 

whan  LSA  Task  401  la  Znltlatad 

LSA  Subtoak  401.2.1 

LSA  -  001  01 root  Annual  Nalntananeo  Man  Hours  by  Skill  Spoelalty  Coda 

LSA  -  001  Paraomal  and  Skill  Staaary 

LSA  -  014  Training  Taak  List 

• 
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•othor  lsaa  Assorts  Avail abls 


Figure  13.  Data  Record  D1  Personnel  and  Support  Equipment 
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requirements  for  the  tasks  listed  on  the  D  Record  and  the  C  Record 
(Figure  14).  It  is  important  to  note  that  the  LSAR  process,  through 
the  system  engineering  and  design,  provides  the  information  needed  to 
determine  training  requirements.  It  is  incumbent  upon  the  program 
offices  to  state  their  LSAR  requirements  in  contractual  agreements. 
This  is  necessary  whether  training  is  to  be  developed  in-house  or  by 
contract.  The  D1  Record  data  elements  include  Skill-Level  Code,  Skill 
Specialty  (or  Air  Force  specialty),  Skill  Specialty  Evaluation  Code, 
and  number  of  personnel  needed  per  specialty. 

E.  Data  Record  E,  Support  Equipment  or  Training  Material  Description  and 
Justification  (Figure  15),  lists  information  related  to  peculiar 
support  and  test  equipment,  test  sets,  and  training  material 
requirements  of  the  system.  Tasks  described  on  C  and  D  Data  Records 
which  show  use  of  support  or  test  equipment  or  require  training 
equipment  should  be  shown  on  separate  E  Data  Records.  Data  Record  E 
provides  a  more  detailed  description  and  justification  which  can  be 
used  to  document  support  equipment  for  contracting  purposes.  The 
record  is  normally  prepared  during  FSD. 

F.  The  LSAR  also  includes  the  Data  Record  G,  Skill  Evaluation  and 
Justification  (Figure  16),  which  describes  and  justifies  new  or 
modified  personnel  skills  required  to  support  the  weapon  system  and 
associated  equipment.  This  is  a  continuation  of  the  Data  Record  D1 
analysis  which  listed  the  new  or  modified  skill  requirements.  The  G 
Record  is  designed  to  provide  information  such  as: 

Duty  position  requiring  new  or  revised  skill 

Air  Force  Specialty  from  which  personnel  can  be  obtained 

Test  score 

Rank/date/civilian  grade 

Skill  specialty  code  assigned  new  duty  position 
Task  codes  (described  on  Data  Records  C  and  D) 

Physical  and  mental  requirements 

Educational  qualifications:  academic  subjects,  specialized 
subjects,  specialized  degrees  and  licenses,  etc. 

Additional  training  requirements 

Justification 

G.  DD  Form  1949-1,  previously  discussed,  correlates  directly  with  the 
data  records.  Properly  used,  this  form  is  a  working  document  which 
will  ensure  the  training  elements  are  developed  by  the  performing 
authority. 
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Provides:  Requirements  for  Training  Equipment 

Initiated:  During  the  Demonstration  and  Validation  (D*V)  Phase 

Date  Source:  LSA  Sub tasks  901.2.4  and  401.2.1 

Output:  *UMU011  Reqult amenta  fox  Special  Training  Devices 


Purpose:  Identify  Nam  or  Modified  Support  Requirements 


•Other  CSM  Reports  Available 

Figure  14.  Data  Record  C  Operation  and  Maintenance  Task  Sumnary 
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Provides: 


Information  on  Paeuliar  Support/ Teat  Equipment  and  Training 
Matarial  Requiraaenta  of  the  Systaa 


Initiated : 


Ourlng  FSO  Phase 


Data  Source: 


LSA  Subtask  401.2.3  aith  Inputs  froa  303.2.6,  303.2.6,  and 
Training  Specialists 


Output: 


None.  *E  Record  is  Manually  Prepared;  Included  in  LSAR  Package 


Purpose : 


Supplsaenta  Reports  Honors tod  By  C  and  01  Data 


•This  Record  la  Autoaated  in  the  U0B2000 


Figure  15.  Data  Record  E  Support  Equipment  or  Training 
Material  Description  and  Justification 


I 


K 


B 


*< 


H.  The  proper  selection  of  LSAR  data  elements  will  enhance  the  training 
development  effort.  The  SPO,  through  the  Training  Planning  Team,  must 
take  advantage  of  the  procedures  prescribed  within  HIL-STD-1388-1A 
and  -1388-2A.  Although  procedures  and  functional  duties  vary  among 
the  many  separate  Program  Offices,  the  LSAR  person  should  be  included 
in  all  planning  efforts  involving  training  development.  The  flow  of 
LSAR  documentation  into  training  development  is  shown  in  Figure  17. 

I.  During  this  review,  it  was  noted  that  LSA  analysis  did  not  always 
coincide  with  training  development  requirements  but  rather,  followed 
a  separate  path  coinciding  with  hardware  development  and  other 
Program  Office  requirements.  In  addition,  the  determination  for 
performing  LSA  and  LSAR  analysis  was  tied  to  the  maturity  of  the 
weapon  system  (e.g.,  the  newer  development  effort  of  C-17  versus  the 
more  established  programs,  such  as  F-16  and  F-15).  Another  considera¬ 
tion  for  the  older  programs  was  the  cost/benefits.  To  request  a 
complete  system  LSA  late  in  the  life  cycle  of  the  weapon  system  would 
not  be  cost  effective;  however,  an  application  of  LSA  on  modifications 
and  engineering  change  proposals  could  be  most  beneficial. 


J.  Each  Program  Office  is  responsible  for  setting  LSA  requirements. 
However,  each  office  has  its  own  finely  drawn  doctrine,  unique 
capabilities  within  assigned  personnel,  and  particular  operating- 
technical  requirements,  all  of  which  can  influence  training 
development.  It  is  important  that  training  be  afforded  the  same 
consideration  as  the  other  functional  areas  (engineering,  logistics, 
financial  control,  test,  and  evaluation)  and  that  a  full-time 
specialist  be  located  in  the  SPO.  At  present,  this  is  not  always  the 
case. 

3.8  AUTOMATING  THE  PROCESS 

A.  Our  findings  noted  that  decisions  on  training  and  training  devices 
are  not  based  on  models  but  upon  rational  and  considered  judgments  by 
the  individuals  who  are  best  suited  to  make  such  assessments. 
However,  such  assessments  require  a  structured  process  or  procedure 
leading  to  the  final  objectives  of  determining  training  requirements 
—  all  within  Air  Force  concepts  and  Government  standards,  to  include 
applicable  data  item  descriptions.  The  process  must  be  complete  and 
done  in  a  manner  that  is  linear  and  interrelated.  Vhen  Air  Force 
concepts  and  a  form  of  ISD  procedures  were  applied  in  the  B-1B 
effort  by  a  contractor,  a  systematic  and  structured  analysis  approach 
resulted.  The  goal  was  to  have  SMSs  in  one  working  session,  break  down 
each  task  to  identify: 

All  steps  and  activities  needed  to  perform  the  task; 
all  skills  and  knowledge  for  performance  of  each  step/activity; 
hands-on  training  required  for  each  skill/knowledge; 
all  other  types  of  tasks  not  requiring  hardware; 
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all  training  device  requirements;  and 
all  training  media. 

B.  At  this  same  time,  it  vas  necessary  to  have  computer  application 
available  to  control  and  manage  the  analysis  effort.  The  automated 
process  that  vas  used  served  to  track  and  format  data  at  the  time 
task  analysis  vas  conducted.  This  process  saved  time,  permitted 
immediate  use  of  the  data  for  analysis  and,  under  a  company  program, 
formatted  the  data  for  hands-on  training  and  training  device 
requirements . 

C.  Application  of  such  a  procedure,  either  by  in-house  Air  Force 
personnel  or  by  contractor  firms,  could  greatly  enhance  the 
development  of  training  requirements  in  a  considerably  shorter  time 
period.  Using  an  automated  system  vith  a  database  management  program, 
training  requirements  can  be  listed,  commonality  analyses  betveen 
tasks  can  be  identified,  selected  data  can  be  formatted  and  printed, 
and  training  concepts  can  be  developed  to  meet  future  acquisition 
program  needs.  ISO  personnel  and  program  office  training  personnel 
could  veil  assess  their  expectations  for  training  courses  and 
training  devices,  since  the  systematic  and  structured  analysis  by 
SME/SMS  using  contractor  engineering  and  LSAR  data  vould  provide  a 
realistic  data  base  and  identify  the  necessary  training  descriptions. 

3.9  ADAPTABILITY  OF  UDB2000  FOR  TRAINING  DEVELOPMENT 

In  their  evaluation  of  the  UDB2000  softvare,  the  3306  TES  focused  on  the 
content  of  MIL-STD-1388-2A  and  the  UDB2000  data  screens.  The  3306  TES  found 
that  the  UDB  data  screens  provide  "quick  and  easy"  access  to  all  information 
necessary  for  the  ISD  process.  They  believe  that  vith  nominal  training,  ISD 
analysts  could  perform  training  development  vith  considerable  savings  in  time, 
manpover,  and  money  for  the  data  collection  process.  Of  course,  LSAR  data 
vould  still  have  to  be  made  available  in  sufficient  quantity  to  realize  the 
advantages  of  the  UDB2000. 

3.10  NEW  DATA  ELEMENTS/ ITEMS 

A.  The  3306  TES  identified  53  LSAR  data  elements  useful  for  ISD 
purposes.  Included  are  those  data  elements  used  for  indexing 
purposes,  such  as  the  Alternate  LSA  Control  Number,  cardblock  of 
A01-2,  shovn  on  LSA  reports  015  and  060  (see  Table  1).  These  data 
elements  can  be  collected  by  reviewing  12  LSARs,  six  LSAR  reports,  or 
28  UDB2000  data  screens. 

B.  One  new  data  element  recommended  specifically  for  training  develop¬ 
ment  vas  a  narrative  entry  to  describe  Student  Target  Population  for 
a  veapon  system  under  development  or  major  modification.  As  a 
minimum,  the  new  data  element  should  include  the  Skill  Specialty  Code 
(i.e.  AFSC),  Skill-Level  Code  (3,  5,  7,  or  9),  prerequisite  education 
and  training,  previous  veapon  system  experience,  and  security 
clearance  requirements. 
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Table  1. 

Training-Related  Data  Elements 
for  ISD 


„v 


50 


Related 

Card- 

LSA 

Data  Element 

DED 

Block 

Report 

1.  Additional  Skill  Requirement:  Skill  Requiring 

010 

G04-5 

075 

a  Nev  or  Revised  Skill  Code 

2.  Additional  Skills  and  Special  Training  Re¬ 

Oil 

E16-5 

070 

quirements 

3.  Additional  Training  Requirements 

013 

G07-5 

075 

4.  Alternate  LSA  Control  Number 

023 

A01-2 

015 

060 

5.  Articles  Requiring  Support 

031.1 

E09-4 

070 

6.  Description  and  Function 

086.1 

E19-5 

070 

7.  Duty  Position  Requiring  a  Nev  or  Revised 

101 

G02-4 

075 

Skill 

8.  Educational  Qualifications 

103 

G06-5 

075 

9.  End  Item  Acronym  Code 

106 

A01-3 

060 

061 

10.  Failure/Damage  Effects 

120 

B14-6 

060 

11.  Failure  Detection  Method 

121 

B15-6 

060 

12.  Failure  Node  and  Cause/Damage  Node 

126 

B13-6 

060 

13.  Failure  Node  Indicator 

128 

Bll  thru 

060 

B18-3 

14.  Functional  Analysis 

145.1 

E17-5 

070 

15.  Hazardous  Maintenance  Procedures  Code 

155 

C06- 10 

060 

16.  Item  Function 

179 

B08-4 

060 

17.  Item  Name 

181 

A03-3 

060 

DO  7 -8 

015 

Bll-3 

070 

H01-9 

061 

18.  Justification 

183 

E20-5 

_ 

G08-5 

— 

Table  1  (Continued) 
Training-Related  Data  Elements 
for  ISD 


Related 

Card- 

LSA 

Data  Element 

DED 

Block 

Repori 

19. 

LSA  Control  Number 

197 

A01-1 

014 

015 

060 

061 

075 

20. 

Maintenance  Concept 

204 

B10-4 

060 

21. 

Manufacturer's  Part  Number 

213 

A04-3 

060 

22. 

Manufacturer's  Part  Number  Overflow 

214 

A05-3 

060 

23. 

Mean  Elapsed  Time 

220 

D06-5 

015 

24. 

Mean  Time  Between  Failures 

235 

B07-4 

060 

25. 

Mean  Time  Between  Maintenance  Actions 

236 

B07-5 

060 

26. 

Mean  Time  to  Repair 

241 

B07-13 

060 

27. 

National  Stock  Number  and  Related  Data 

259 

E05-3 

070 

H02-5 

061 

28. 

Performance  Standards 

313 

D06-7H 

014 

29. 

Person  Identifier 

316 

D02-7 

015 

30. 

Physical  and  Mental  Requirements 

319 

G05-5 

075 

31. 

Qualitative  and  Quantitative  Maintain¬ 
ability  Requirements 

348 

B09-4 

060 

32. 

Quantity  Per  Task 

354 

D07-9 

060 

33. 

Reference  Number 

372 

H01-1 

061 

34. 

Referenced  Task 

376 

D03-7 

015 

35. 

Security  Clearance 

399 

G02-7 

— 

36. 

Sequence  Insertion  Line  Number 

403 

D02-3 

015 

37. 

Sequence  Line  Number 

406 

D02-2 

015 

38. 

Sequential  Task  Description 

410 

D02-5 

015 

39.  Skill  Level  Code 


422 


All-7 


060 
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Table  1  (Concluded) 
Training-Related  Data  Elements 
for  ISD 


Related 

Card- 

LSA 

Data  Element 

DED 

Block 

Report 

40. 

Skill  Specialty  Code  (SSC) 

423 

All-6 

060 

D04-4 

015 

41. 

SSC  Assigned  Nev  Duty  Position 

424 

G01-3 

075 

42. 

Skill  Specialty  From  Vhich  Personnel  Can 

Be  Obtained 

434 

G02-5 

— 

43. 

Source,  Maintenance  and  Recoverability 

436 

Hll-7 

061 

44. 

Support  Equipment  Full  Item  Name 

455.1 

E13-3 

070 

45. 

Support  Equipment  Recommendation  Data  (SERD) 
Number 

458 

E02-3 

070 

46. 

Support  Item  Sequence  Code 

460 

D07-4 

060 

47. 

Task  Code 

467 

C06-3 

015 

060 

48. 

Task  Condition 

468 

D06-7G 

014 

49. 

Task  Frequency 

470 

C06-4 

015 

060 

50. 

Task  Identification 

472 

C06-6 

015 

060 

51. 

Task  Identification  Code 

473 

C06-7 

015 

060 

52. 

Unit  of  Measure 

524 

D07-10 

060 

53. 

Work  Unit  Code/Technical  Manual  Functional 

545 

A04-7 

015 

Group  Code 

060 

Source:  3306  TES  Letter,  Subject:  UDB2000  Study,  30  October  1986, 
Attachaent  1 


C.  The  data  element  Training  Rationale,  covered  by  DED  503,  was  cited  as 
having  eight  codes  to  justify  training  requirements  recommendations.  The  3306 
TES  recommended  a  change  to  a  narrative  entry  or  adopting  the  use  of  data 
element,  Justification,  covered  by  DED  183.  It  was  further  recommended  that 
the  data  element  Justification  be  added  to  LSAR  reports  070  and  075  to  support 
training  recommendations. 

3.11  NEW  UDB  DATA  SCREENS/OUTPUT  REPORTS 

The  3306  TES  also  identified  the  need  for  new  screens,  designed  especial¬ 
ly  for  training-related  data.  Presently,  the  UDB2000  has  28  data  screens  that 
contain  information/data  elements  needed  for  the  ISD  process.  Although  access 
to  these  screens  was  found  to  be  easily  accomplished  by  the  training  analysts, 
additional  research  time  is  needed  by  the  3306  TES  to  fully  define  and  con¬ 
struct  additional  screens  that  could  enhance  training  development.  Further, 
the  squadron  believes  that  the  UDB  screens  developed  to  date  could  be  an  asset 
to  other  LSA  users  and  acquisition-related  organizations. 

3.12  REVISION  TO  MIL-STD-1388-2A 

A.  To  better  define  the  student  target  population,  a  data  element 
descriptor  (DED)  should  be  established  to  do  so.  As  noted,  the  new 
data  element  should  include  the  skill  specialty  code  (AFSC),  skill- 
level  code,  prerequisite  education/training,  previous  weapon  system 
experience,  and  security  clearance.  The  DED  should  be  structured  to 
capture  a  narrative  summary  of  this  type  of  information.  At  present, 
DED  434,  Skill  Specialty  From  Which  Personnel  Can  Be  Obtained, 
provides  a  specialty  code;  however,  it  does  not  define  previous 
weapon  system  experience,  education  and  training,  or  prerequisite 
skills  and  knowledge  information. 

B.  Training  Rationale,  DED  503,  should  be  examined  for  change  to  a 
narrative  entry  or  be  replaced  by  Justification,  DED  183.  Although 
DEC  503  has  eight  codes  to  justify  training  requirements,  a 
narrative-type  entry  would  allow  training  analysts  the  latitude  to 
descibe  their  decision  logic.  The  3306  TES  also  recommended  that  the 
justification  information  be  added  to  LSAR  070  and  075  reports  to 
support  training  recommendations. 


IV.  CONCLUSIONS 


4.1  AUTOMATING  TRAINING  REQUIREMENTS  PROCESSES 

A.  The  weapon  system  acquisition  process  must  be  analyzed  in  terms  of 
both  systems  design  and  training  system  design.  The  training  system 
design  process  can  begin  earlier  through  the  use  of  mission  area 
analysis  and  comparability  analysis,  which  include  all  the  pertinent 
documents  leading  up  to  the  development  phase.  Training  systems,  in 
turn,  can  be  further  examined  as  to  the  subsystem  functional  require¬ 
ments  and  the  task  data  necessary  for  operational  and  maintenance 
purposes.  Data  to  support  this  analysis  come  primarily  from  the 


contractors  involved  and  the  SPO,  their  design  engineers  and 
logistics  specialists.  Although  the  process  currently  is  conducted  by 
in-house  Air  Force  technicians  and  a  number  of  contractor  agencies, 
it  is  limited  in  scope  and  depth  by  the  degree  of  automation,  the 
availability  of  data,  and  the  qualifications/training  of  subject- 
matter  specialists/experts. 

B.  Task  analysis  and  associated  task  information  gathering  is  a  major 
effort  of  the  overall  training  systems  development  program  performed 
by  the  SPO  and  ATC.  Engineering  and  design  data  must  be  made  avail¬ 
able  through  contractor  deliverables  according  to  HIL-STD-1388-2A, 
usually  in  the  form  of  LSAR  and  DIO  deliverables.  The  deliverables 
should  also  be  timely  and  incremented  for  analysis  beginning  early  in 
the  acquisition  process.  For  those  systems  where  design  is  not  final 
or  complete,  consideration  should  be  given  to  generic  task  analysis 
using  comparability  data  from  a  predecessor  system  as  input. 

C.  Automation  of  LSAR  data,  with  on-line  capability  for  use  by  the  SPO 
and  ISD  analysts  would  produce  a  more  direct  and  timely  information 
link,  and  also  afford  training  and/or  HPT  analysts  an  earlier  start 
in  task  list  development  as  the  new  system  equipment  lists  surface. 
From  the  task  lists  begins  the  identification  of  subtasks  or  substeps 
required  to  perform  the  task.  This  lower-level  description  will 
define  the  actions  related  to  each  specific  task  and  the  systems/ 
equipments  on  which  the  action  is  to  be  performed.  SMSs  can  list  all 
conditions  relevant  to  the  steps  and  substeps  of  the  tasks,  (e.g., 
special  tools,  equipment  conditions,  and  safety  measures).  LSARs 
should  be  reviewed  in  sufficient  derail  to  capture  all  such  informa¬ 
tion  and  data  elements. 

D.  Following  the  listing  and  description  of  all  steps  and  substeps,  the 
necessary  skills/knowledge  must  be  determined  by  the  subject-matter 
experts.  This  may  be  accomplished  using  a  format  (forms)  or  prompt 
procedure  to  ensure  all  knowledge  and  skill  requirements  are  made 
knovn.  The  application  of  a  data  base  system  method  similar  to  that 
used  for  the  B-1B  can  format  the  data  for  needed  outputs.  A 
commonality  analysis  would  provide  information  on  like  data  as  to 
tasks,  steps,  substeps,  skills,  knowledge,  training  requirements,  and 
training  systems,  as  well  as  the  recall  or  manipulation  of  other 
selected  data. 

E.  Automation  of  training  requirements  data  would  permit  earlier 
processing  of  information  to  identify  needed  training  courses,  media, 
hardware,  and  training  locations  by  the  SPO  and  ATC  (see  Figure  18). 

4.2  AVAILABILITY  OF  INFORMATION 

A.  Information,  or  lack  of  information,  influences  training  and  training 
equipment  development,  in  that  there  continues  to  be  a  difference  in 
time-phasing  of  events  between  training  systems  development  and 
veapon  system  acquisition.  Some  of  this  difference  can  be  attributed 
to  the  many  coordinating  and  involved  offices,  and  in  part  to  a  late 
finalization  in  design  and/or  operational  and  maintenance  concepts. 
Regardless  of  the  underlying  causes,  the  SPO  must  lead  the  management 
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Figure  18.  Automated  Training  Requirements  Process 


effort  in  the  actual  acquiring  of  the  training  and  maintenance 
training  devices. 


B.  If  information  is  not  available,  SMSs  will  make  necessary  assumptions 
in  order  to  complete  the  ISD  and  the  documentation  for  starting  the 
training  equipment  acquisition.  This  is  often  an  initial  or  "get- 
started"  effort,  with  the  goal  of  meeting  schedules  and  having  needed 
training  programs  on  board  before  or  by  IOC.  It  is  reasonable  to 
believe  that  any  new  program  not  fully  committed  to  a  method  of 
operation,  maintenance  concept,  or  design  agreement  would  continue 
to  distract  the  training  development  process. 

C.  Another  area  that  impacts  training  development  is  the  defining  of  the 

trainee  population.  The  user  MAJCOM,  in  addition  to  stating  the 

maintenance  concept,  should  also  define  the  trainee  population  in 
terms  of  education  and  training  qualifications  and  the  AFSCs  and 
skill  levels  needed.  This  often  turns  out  to  be  a  minimum-effort 
result, or  a  difficult  task,  in  the  sense  that  HAJCOMs  do  not  always 
have  the  personnel  or  experience  to  adequately  define  trainee 
population.  This,  in  turn,  impacts  the  ISD  process  in  that  training 
is  built  around  the  anticipated  need  for  new  skills  and  knowledge 
requirements.  Therefore,  a  need  for  careful  judgement  by  SHSs  is 
required  today  as  in  the  past. 

D.  Another  factor  of  concern  is  deliverable  task  data  for  the  task  and 
skill  analysis  effort  which  is  basic  to  completing  an  ISD.  The 
present  investigation  shoved  that  the  data  come  late,  usually  after 
Milestone  II  or  the  DEM/VAL  phase,  and  in  some  cases  are  not 
furnished  through  MIL- STD- 1388- 2 A  LSAR.  In  essence,  a  weapon  system 
in  a  prototype  phase  will  lack  the  maturity  to  produce  completely 
usable  or  valid  data. 

E.  Until  FEA  can  be  developed  in  a  manner  to  satisfy  training-related 
information  needs,  ISD  teams,  whether  Air  Force  or  contractor,  must 
continue  to  work  with  the  SPO,  program  contractors,  MAJCOM,  etc.  to 
develop  training  and  training  equipment  requirements. 

4.3  ORGANIZATIONAL/FRONT-END  ANALYSIS  INFLUENCE 

A.  Training  must  be  given  adequate,  early  consideration  as  part  of  the 
front-end  analysis.  As  tools  to  aid  FEA  (such  as  the  MPT  Systems 
Model)  are  further  refined  and  accepted  into  the  acquisition 
community,  the  system  managers  must  provide  increased  authority  to 
the  Training  and  LSA  project  officers.  Historically,  training  has 
been  viewed  as  only  one  of  many  ILS  elements,  often  without  the 
benefit  of  an  experienced  person  assigned  to  manage  the  training 
program.  This  tends  to  downplay  the  importance  of  training  system 
development  as  part  of  the  weapon  system  design  effort. 

B.  It  should  be  noted  that  front-end  analysis  begins  at  the  system  level 
in  the  Concept  Exploration  phase  (CE)  and  proceeds  toward  a  more 
detailed  level  in  DEM/VAL  phase.  Thus,  with  earlier  MPT  influences, 
the  specifications  for  maintenance  and  aircrew  training  devices  could 
be  developed  in  the  DEM/VAL  phase  versus  the  present  method  of 


delaying  ISD  until  full-scale  development.  Further,  it  must  be 
remembered  that  conceptual  data  formed  during  FEA  are  continually 
refined,  influencing  instructional  design  and  finally,  training 
methods  and  media  development.  If  properly  directed,  FEA  data  will 
provide  input  into  LSA/LSAR,  and  subsequently  provide  data  for  the 
ISD  documentation. 

C.  Influencing  the  design  process  under  a  strongly  supported  FEA 

necessitates  the  timely  flow  of  tailored  data  from  the  prime 
contractor  to  the  SPO.  Thus,  the  training  and  LSA  managers  must  have 
properly  specified  their  needs  in  the  CDRLs  for  the  CE  and  DEM/VAL 
phases  and  have  had  sufficient  authority  to  interface  with  the 

contractor  engineers,  LSAR  personnel,  and  SPO  users  of  the  data. 

4.4  MILITARY  STANDARD  GUIDANCE 

MIL-STD-1388-1A  guidance  was  found  to  be  adequate.  The  Military  Standard 
provides  an  LSA  tailoring  strategy  for  identifying  necessary  tasks  to  meet 
system  program  objectives.  The  guidance  is  stated  at  a  level  of  detail  and 
with  time-phasing  that  should  permit  proper  planning  of  logistics  elements  to 
include  training  programs  and  requirements.  The  standard  is  applicable  to 
both  contractor  and  Government  activities.  The  Military  Standard  "Foreword" 
states,  in  part,  "Increasing  awareness  that  supportability  factors,  such  as 
manpower  and  personnel  skills,  are  a  critical  element  in  system  effectiveness 
has  necessitated  early  support  analyses,  the  establishment  of  system  con¬ 
straints,  design  goals,  thresholds  and  criteria  in  these  areas,  and  the 
pursuit  of  design,  operational  and  support  approaches  which  optimize  life 

cycle  costs  and  the  resources  required  to  operate  and  maintain  systems.  This 

standard  was  prepared  to  identify  these  early  analysis  requirements  and  foster 
their  cost  effective  application  during  system  acquisitions."  As  such,  LSA 
guidance  is  designed  to  assist  Program  Offices  but  allows  for  flexibility  and 
adaptation  to  specific  programs. 

4.5  DATA  ELEMENTS/ ITEMS 

A.  The  LSAR  system,  HIL-STD-1388-2A,  contains  the  data  elements  and  data 
items  useful  in  training  development.  Table  2  lists  those  data  ele¬ 
ments  considered  to  be  useful  within  acquisition  for  training  devel¬ 
opment  purposes  in  general.  The  table  lists  the  LSAR  data  record, 
card  number  and  block,  and  the  applicable  LSA  report  numbers.  Lower- 
level  data  items  are  included  where  applicable.  The  corresponding  UDB 
screens/sheets  are  shown  for  reference  under  the  UDB2000  system.  In 
addition,  the  3306  TES  identified  53  LSAR  data  elements  needed  for 
ISD  purposes  during  their  review.  These  53  data  elements  are  listed 
in  Table  1. 

B.  Also,  during  development  of  the  UDB,  additional  data  elements  useful 
for  Air  Force  purposes  were  identified  within  logistics;  some  may 
have  future  application  for  training  purposes.  Table  3  lists  these 
data  elements  by  noun,  purpose,  and  the  UDB  screen/sheet  location. 
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4.6  MANPOWER,  PERSONNEL,  AND  TRAINING  (MPT)  DIRECTORATE 


A.  The  recently  established  ASD/ALH  Directorate  should  become  a  vital 
element  in  the  integration  of  MPT  issues  in  the  acquisition  cycle. 
The  basic  purpose  of  MPT  analysis,  which  is  to  quantify  impacts  on 
both  current  and  planned  weapon  systems  and  to  develop  alternative 
MPT  utilization  concepts  and  system  designs  to  optimize  the 
effectiveness  of  our  forces,  can  be  more  fully  realized  as  the 
Directorate  expands  its  involvement  within  the  acquisition  community. 
In  this  effort,  ALH  will  be  focusing  on  improvements  in  maintenance 
and  support  of  HPT  issues  and  reflecting  upon  the  concerns  and 
planning  efforts  of  the  using  commands,  supporting  commands,  and 
program  offices. 

B.  Under  the  Directorate's  concept  of  operations,  the  development  of 
databases  and  analytical  techniques  for  MPT  considerations  in  the 
design  process  will  unfold.  ALH  should  also  aid  the  SPO  in 
establishing  an  MPT  baseline  and  handling  impacts  caused  by  design, 
operations,  or  maintenance  concept  changes.  Policy  reviev  and 
development  will  be  a  key  role  of  this  office,  and  management  must 
consolidate  present  MPT  efforts  and  serve  as  the  final  clearing  house 
on  all  matters  of  MPT  direction  and  issues. 

C.  The  Directorate  should  eventually  provide  MPT  expertise  to  the 
Program  Offices  and  advise,  assist,  and  provide  information,  models, 
and  methodologies  to  support  all  aspects  of  MPT  planning.  In  this 
manner,  the  SPOs  should  be  able  to  compare,  project,  and  assess 
various  design  options  and  operational  and  maintenance  trade-offs  for 
their  relative  impacts  on  MFf  and  life-cycle  costs.  This  capability, 
when  formalized,  should  also  help  eliminate  costly  changes  in 
planning,  programming,  and  funding  of  MPT  resources  due  to  incomplete 
front-end  analysis. 

4.7  RECOMMENDATIONS 

A.  Manpower,  personnel,  and  training  should  be  given  adequate  considera¬ 
tion  as  part  of  the  front-end  analysis,  vith  FEA  applied  early  in  the 
Concept  Exploration  (CE)  and  Demonstration  (DEM/VAL)  phases. 

B.  MPT  or  training  requirements  should  be  afforded  the  same  level  of 
interest  as  the  systems  engineering  during  the  acquisition  process. 
Training  managers  must  have  sufficient  authority  to  influence  MPT 
requirements  for  training  system  design. 

C.  Design  data  requirements  should  be  placed  on  contract  for  MPT 
purposes  early  in  the  CE  and  DEM/VAL  phases,  through  selected 
listings  on  the  CDRLs  and  the  tailoring  of  data  item  descriptions 
(DIDs).  The  Training  Development  Plan  should  be  expanded  to  include 
those  DIDs  required  for  training  data,  and  updated  as  necessary  after 
program  revievs. 

D.  Program  revievs  and  other  planning  meetings  should  be  attended  by  all 
MPT-  and  LSA-involved  members  on  a  regular  basis.  Revievs,  planning 
meetings,  vorking  groups,  and  briefings  should  be  coordinated  efforts 


—  whether  conducted  by  the  SPO,  SIMSPO,  ATC,  or  the  contractor  —  in 
an  effort  to  keep  the  flow  of  information  and  data  on  a  continuous, 
parallel  course. 

Interfaces  should  be  established  and  maintained  during  acquisition 
phases  between  the  SPO  training  and  LSA  managers,  SIMSPO  MPT 
managers,  and  prime  contractor  training  system  and  LSA  managers. 

Automated  LSAR  systems  should  be  adopted,  with  on-line  capability 
from  the  contractor  to  the  SPO  and  Responsible  Test  Agency  for  ISO. 

SPO  training  and  LSA  managers  should  be  scheduled  to  attend,  as  a 
minimum,  the  following  courses: 

Air  Force  MPT  Systems  Model  Course  (conducted  by  Booz,  Allen, 
Hamilton,  Inc.,  for  the  SIMSPO). 

LSA/ LSAR  Course  (conducted  by  AFALC/ERL) 

A  new  data  element  descriptor  (DED)  should  be  established  for  Student 
Target  Population,  to  permit  a  narrative  summary  and  listing  for 
skill-level  code,  skill  specialty  code,  prerequisite  education  and 
training,  previous  weapon  system  experience,  and  security  clearance. 

DED  503  (Training  Rationale)  should  be  examined  for  change  to  a 
narrative  entry  to  justify  training  requirements  or  be  replaced  by 
DED  183  (Justification).  In  addition,  this  type  of  information  should 
be  examined  for  inclusion  in  LSAR  reports  070  and  075. 
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VI.  GLOSSARY  OF  TERMS  AND  ACRONYMS 


AFALC 

Air  Force  Acquisition  Logistics  Center 

AFB 

Air  Force  Base 

AFHRL 

Air  Force  Human  Resources  Laboratory 

AFLC 

Air  Force  Logistics  Command 

AFS 

Air  Force  Specialty 

AFSC 

Air  Force  Specialty  Code 

ALC 

Air  Logistics  Center 

AMT 

Aircraft  Maintenance  Training 

AFOTEC 

Air  Force  Operational.  Test  and  Evaluation 

ASD 

Aeronautical  Systems  Division 

ATC 

Air  Training  Command 

CDRL 

Contract  Data  Requirements  List 

CE 

Concept  Exploration 

DED 

Data  Element  Dictionary 

DEM/VAL 

Demons tration/Validat ion 

DID 

Data  Item  Description 

DPML 

Deputy  Program  Manager  for  Logistics 

FEA 

Front-End  Analysis 

FSD 

Full-Scale  Development 

FTD 

Field  Training  Detachment 

ICS 

Interim  Contractor  Support 

IDD 

Integrated  Data  Dictionary 

IDMS 

Integrated  Data  Management  System 

ILS 

Integrated  Logistics  Support 

ILSP 

Integrated  Logistics  Support  Plan 

IOC 

Initial  Operational  Capability 
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ISO 

ISLM 

LCN 

LSA 

LSAR 

MPT 

MRSA 

MTT 

NHA 

PLISN 

PM 

PMD 

PMP 

PPBS 

PRP 

RFP 

R&M 

RTA 

SASC 

SME 

SMS 

SPO 

SON 

SOV 

TOP 

TES 


Instructional  System  Development 
Integrated  Logistics  Support  Manager 
Logistics  Support  Analysis  Control  Number 
Logistic  Support  Analysis 
Logistics  Support  Analysis  Record 
Manpower,  Personnel,  and  Training 
Material  Readiness  Support  Activity  (Army) 

Mobile  Training  Team 

Next  Higher  Assembly 

Provisioning  List  Item  Sequence  Number 

Program  Manager 

Program  Management  Directive 

Program  Management  Plan 

Planning,  Programming,  and  Budgeting  System 

Program  Review  Package 

Request  for  Proposal 

Reliability  and  Maintainability 

Responsible  Test  Agency 

Systems  and  Applied  Sciences  Corporation 

Subject-Matter  Expert 

Subject-Matter  Specialist 

System  Program  Office 

Statement  of  Operational  Need 

Statement  of  Work 

Training  Development  Plan 

Test  and  Evaluation  Squadron 

Training  Requirements  Recommendation  Review  Meeting 
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TIES  Task  Identification  and  Evaluation  System 

TTC  Technical  Training  Center 

UDB  Unified  Data  Base 

VBS  Work  Breakdown  Structure 

W-P  AFB  Wright-Pat terson  Air  Force  Base 


